Hyojun Go
About Me
I am a Research Scientist at Twelvelabs Video Language Model team. I received my M.S. degree from Korea Advanced Institute of Science and Technology (KAIST) in 2022, advised by Prof. Changick Kim. My research interests include generative models (especially Diffusion Models), 3D generation, and video understanding.
Research Interests
- Diffusion Models: I think that diffusion models inherently take a multi-task learning, where a single model learns multiple denoising tasks across different noise levels. If we can harmoniously train a model with these tasks, I believe that the model can generate high-quality samples with small computational resources (parameters). Please check out our papers on NeurIPS 2023, ICLR 2024, ECCV 2024, CVPR 2023, and AAAI 2024.
- 3D Generation: My ultimate research goal is to generate and edit immerse 3D and 4D world scenes. Based on the power of generative models, inducing the scene’s geometry prior, representation, and physics to them is aligned with my research interest. This reflects my publications on 3D aware generation: TPAMI 2024, CVPR 2024
- Video Understanding: In addition, I am interested in advancing Video Language Models for improved video understanding. Pegasus Tech Report
News
- [Jul. 2024] One paper about Diffusion Model is accepted to ECCV 2024.
- [Mar. 2024] One paper about Novel View Synthesis is accepted to TPAMI 2024.
- [Feb. 2024] One paper about One-Image-to-3D is accepted to CVPR 2024.
- [Jan. 2024] One paper about Diffusion Model is accepted to ICLR 2024.
- [Dec. 2023] One paper about Diffusion Model is accepted to AAAI 2024.
- [Sep. 2023] One paper about Diffusion Model is accepted to Neurips 2023.
Research Experiences
- Twelvelabs, Seoul, Korea
- Research Scientist (Sep. 2023 - present)
- Video Language Models: Pegasus-v1
- Riiid, Seoul, Korea
- Research Scientist (Mar. 2022 - Aug. 2023)
- Diffusion Models
- KAIST, Daejeon, Korea
- M.S. in Electrical Engineering (Mar. 2020 - Feb. 2022)
Education
- M.S. in Electrical Engineering - KAIST, Daejeon, Korea (Mar. 2020 - Feb. 2022)
- B.S. in Electrical Engineering - Hanyang University, Seoul, Korea (Mar. 2015 - Aug. 2019)
Publications
-
Technical Report
Technical Report, 2024. -
ECCV
European Conference on Computer Vision (ECCV), 2024. -
Technical Report
-
TPAMI
IEEE Transactions on Pattern Analysis and Machine Intelligence. (TPAMI), 2024. -
CVPR
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. -
ICLR
International Conference on Learning Representations (ICLR), 2024. -
AAAI
AAAI Conference on Artificial Intelligence (AAAI), 2024 -
NeurIPS
Advances in Neural Information Processing Systems (NeurIPS), 2023 -
ACL
2023 Meeting of the Association for Computational Linguistics (ACL) findings short, 2023 -
ACL
2023 Meeting of the Association for Computational Linguistics (ACL) findings short, 2023 -
CVPR
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 -
ECCVW
European Conference on Computer Vision Workshop (ECCVW), 2022 -
WACV
The IEEE/CVF winter conference on applications of computer vision (WACV), 2022 -
WACV
The IEEE/CVF winter conference on applications of computer vision (WACV), 2022 -
ICIP
IEEE International Conference on Image Processing (ICIP), 2021
Services
Conference Reviewers
- ICLR: 2025
- CVPR: 2024
- Neurips: 2024
- ECCV: 2024
- ACL Rolling Review: 2024 Feb, 2024 June, 2024 Aug
Awards and Honors
- AI Seoul Invited Talks (February 2024): Presented on the topic of “Addressing Negative Transfer in Diffusion Models” in Seoul City Hall.
- Summa Cum Laude (August 2019): Graduated with a GPA of 4.28 out of 4.5.
- Hanyang Academic Excellence Award (May 2018): Recognized for outstanding academic achievement.
- Hanyang Academic Excellence Award (October 2017): Recognized for outstanding academic achievement.
Powered by Jekyll and Minimal Light theme.