Hi there, I'm Siteng Huang (黄思腾 in Chinese)! 👋 You can also call me Kyon Huang.

I am a fifth-year Ph.D. student at Zhejiang University, advised by Prof. Donglin Wang. Additionally, I am involved in a joint program with Westlake University as a member of Machine Intelligence Laboratory (MiLAB). Currently, I am also a research intern at Alibaba Group. Prior to my Ph.D. career, I received my B.Eng. Degree from School of Computer Science, Wuhan University in 2019.

Expected to obtain the Ph.D. degree in July, 2024.

🔍 Currently, My research has centered on multi-modal large models, especially vision-language models (VLMs), including

• Generation/AIGC: text-to-image/video (T2I/V) generation^ADI,SimM, customized & controllable generation^ADI,SimM, diffusion models^{ADI,SimM,VGDiffZero}, multi-modal large language models (MLLMs)^Cobra
• Understanding: text-video retrieval (TVR)^VoP, compositional zero-shot learning (CZSL)^Troika, few-shot learning (FSL)^AGAM,HTS, visual grounding^{VGDiffZero,DARA}
• Adaptation: parameter-efficient fine-tuning (PEFT/PETL)^VoP,DARA, meta-learning^MRN, transfer learning^PDA
• Embodied AI: foundation models for robotics

I am always looking for related collaborations, and most of them have produced top-level publications. Feel free to drop me an email if you are interested!

💬 News:

• [May 5, 2024] Our Cobra was selected for VALSE 2024 Annual Progress Representation. Thanks to all the committee for the approval!
• [March 29, 2024] Troika got accepted as VALSE 2024 Poster!
• [March 21, 2024] Cobra, an efficient multi-modal large language model, was released. Project page has been available. The paper has been featured by Hugging Face Daily Papers! Demo has been available!
• [March 13, 2024] One paper about parameter-efficient tuning for visual grounding got accepted for ICME 2024 (Oral).
• [February 27, 2024] Awarded as Zhejiang University 2024 Outstanding Graduates!
• [February 27, 2024] Three papers (ADI, Troika, SimM) as first/co-first author got accepted for CVPR 2024. Congratulations to all collaborators!
• [December 13, 2023] The paper of VGDiffZero on diffusion model-based zero-shot visual grounding got accepted for ICASSP 2024. Congratulations to all collaborators!
• [December 9, 2023] One paper on VLM-based unsupervised domain adaptation got accepted for AAAI 2024.
• [July 24, 2023] 2023 Scholar Metrics was released by Google Scholar. Our paper "DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting" ranked 8th of the CIKM 2019 conference according to the citations, and 26th within five years.
• [April 2, 2023] The paper of RL-CZSL about reference-limited compositional learning got accepted for ICMR 2023. Congratulations to all collaborators!
• [February 28, 2023] The paper of VoP about parameter-efficient text-video retrieval got accepted for CVPR 2023. Congratulations to all collaborators!

📫 Contact me by:

• Email: siteng.huang[at]gmail.com (Please change [at] to @)