Jiapeng Shi, Junke Wang, Zuyao You, Bo He, Zuxuan Wu✉
[📜 Paper] [📥 Model] [🤗 Dataset]
This paper presents VideoLoom, a unified Video Large Language Model (Video LLM) for joint spatial-temporal understanding. To facilitate the development of fine-grained spatial and temporal localization capabilities, we curate LoomData-8.7k, a human-centric video dataset with temporally grounded and spatially localized captions. With this, VideoLoom achieves state-of-the-art or highly competitive performance across a variety of spatial and temporal benchmarks (e.g., 63.1 J&F on ReVOS for referring video object segmentation, and 48.3 R1@0.7 on Charades-STA for temporal grounding). In addition, we introduce LoomBench, a novel benchmark consisting of temporal, spatial, and compositional video-question pairs, enabling a comprehensive evaluation of Video LLMs from diverse aspects. Collectively, these contributions offer a universal and effective suite for joint spatial-temporal video understanding, setting a new standard in multimodal intelligence.
Jan. 13, 2026Our paper and checkpoints are released.
We provide the following models:
| Model Name | Base MLLM | Checkpoints |
|---|---|---|
| VideoLoom-4B | InternVL2.5-4B | 🤗 link |
| VideoLoom-8B | InternVL3-8B | 🤗 link |
- Release our checkpoints
- Release our evaluation code
- Release LoomData
- Release our training code
- Release LoomBench
If you find our work helpful, please consider giving a star ⭐ and citation 📝
@article{shi2026videoloom,
title={VideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understanding},
author={Shi, Jiapeng and Wang, Junke and You, Zuyao and He, Bo and Wu, Zuxuan},
journal={arXiv preprint arXiv:2601.07290},
year={2026}
}
Feel free to contact us if you have any questions or suggestions
- Email (Jiapeng Shi): jpshi1212@gmail.com
We refer to Sa2VA and TimeChat to build our codebase. Thanks for their wonderful project.