multimodal-datasets

Here are 17 public repositories matching this topic...

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

deep-learning salesforce image-captioning deep-learning-library vision-framework vision-and-language multimodal-deep-learning multimodal-datasets vision-language-transformer vision-language-pretraining visual-question-anwsering

Updated Oct 11, 2024
Jupyter Notebook

yuanxiaosc / Multimodal-short-video-dataset-and-baseline-classification-model

Star

500,000 multimodal short video data and baseline models. 50万条多模态短视频数据集和基线模型（TensorFlow2.0）。

tensorflow-models classification-model multimodal-datasets video-dataset

Updated Jul 23, 2019
Jupyter Notebook

AnkurDeria / MFT

Star

Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.

deep-learning remote-sensing hyperspectral-image-classification multimodal-deep-learning multimodal-datasets transformer-models hsi-classification

Updated Dec 23, 2023
Jupyter Notebook

drmuskangarg / Multimodal-datasets

Star

This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information about recent multimodal datasets which are available for research purposes. We found that although 100+ multimodal language resources are available…

multimodal-datasets

Updated Jan 10, 2022

JunweiLiang / FVTA_MemexQA

Star

Real-world photo sequence question answering system (MemexQA). CVPR'18 and TPAMI'19

visual-question-answering vision-and-language multimodal-deep-learning multimodal-datasets multimodal-representation memex-question-answering memexqa-dataset

Updated Jul 1, 2019
Python

remyxai / VQASynth

Star

Compose multimodal datasets 🎹

dataset-generation data-processing data-pipeline synthetic-dataset-generation multimodal-deep-learning multimodal-datasets

Updated Nov 7, 2024
Python

piresramon / gpt-4-enem

Star

Code and data to evaluate LLMs on the ENEM, the main standardized Brazilian university admission exams.

artificial-intelligence multimodal-datasets llms llm-inference

Updated Nov 29, 2023
Python

wisdomikezogwo / quilt1m

Star

[NeurIPS 2023 Oral] Quilt-1M: One Million Image-Text Pairs for Histopathology.

vlm medical-dataset multimodal-datasets histopathology clip-model

Updated Jan 18, 2024
Python

marslanm / Multimodality-Representation-Learning

Star

This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .

cross-modal multimodal-deep-learning multimodal-datasets transformer-models multimodal-pre-trained-model vision-language-pretraining multimodal-applications multimodal-pretext

Updated Oct 19, 2023

ImKeTT / Awesome-Multi-Modal-Dialog

Star

[Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics

dialogue awesome-list multimodal-learning multimodal multimodal-deep-learning multimodal-datasets paperlist dialogue-system multimodal-dialogue

Updated Oct 10, 2022

OlehOnyshchak / pyWikiMM

Star

Collects a multimodal dataset of Wikipedia articles and their images

Updated Mar 25, 2023
Python

clp-research / language-models-multimodal-tasks

Star

Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"

language-model multimodal-learning multimodal-sentiment-analysis multimodal-datasets