Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
-
Updated
Jul 18, 2024 - Python
Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
[CVPR 2022] A large-scale public benchmark dataset for video question-answering, especially about evidence and commonsense reasoning. The code used in our paper "From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-Answering", CVPR2022.
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
Can I Trust Your Answer? Visually Grounded Video Question Answering (CVPR'24, Highlight)
[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"
Data and PyTorch code for the LifeQA LREC 2020 paper.
A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
FreeVA: Offline MLLM as Training-Free Video Assistant
Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)
Open-Vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models (ICCV 2023)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models (CVPR 2023)
[CVPR 2023 Highlight] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning
[NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations
Contrastive Video Question Answering via Video Graph Transformer (IEEE T-PAMI'23)
[TIP 2022] Official code of paper “Video Question Answering with Prior Knowledge and Object-sensitive Learning”
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
A PyTorch implementation of EmpiricalMVM
A PyTorch implementation of VIOLET
NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)
Add a description, image, and links to the video-question-answering topic page so that developers can more easily learn about it.
To associate your repository with the video-question-answering topic, visit your repo's landing page and select "manage topics."