I am Heejun Lee. I am an undergraduate student at the KAIST School of Computing. Hello, World! 🐱

My research interest includes:

• Neural Network Compression and Computation Optimization
• Large-scale Machine Learning System Design, Develop, and Serving
• General Purpose AI (NLP/CV)

Education

• Korea Advanced Institute of Science and Technology (KAIST) | Mar. 2020 - Aug. 2024 (Expected) | B.S. in Computer Science

Conference Publications

SEA: Sparse Linear Attention with Estimated Attention Mask

[paper][code] Heejun Lee, Jina Kim, Jeffrey Willette, Sung Ju Hwang. ICLR 2024

---

Sparse Token Transformer with Attention Back Tracking

[paper][code] Heejun Lee, Minki Kang, Youngwan Lee, Sung Ju Hwang. ICLR 2023

---

(*: equal contribution)

Experiences

• KAIST MLAI. Oct 2022 -. Undergraduate Internship; Jul 2021 - Oct 2022. Undergraduate Individual Research
• DeepAuto.ai. Jan 2023 - May 2023. Research Engineer
• Transverse. Oct 2020 - Mar 2021. AI Lead Developer

Awards

• 23'F KAIST College of Engineering Leadership Award on Research Excellence
• 22'F KAIST College of Engineering Leadership Award on Research Excellence
• 22'S KAIST College of Engineering Dean's List
• 18' Intel International Science and Engineering Fair Finalist & 4th Grand Award in Robotics and Intelligent Machines
• 18' 제 9회 한국청소년과학창의대회(ISEF-K) 1등 (1st Place)
• 17' 제 34회 한국정보올림피아드(Korea Olympiad in Informatics; KOI) 공모부분 금상 (Gold Medal; 2nd Place)
• 16' 제 33회 한국정보올림피아드(Korea Olympiad in Informatics; KOI) 공모부분 금상 (Gold Medal; 2nd Place)