Hands on some MultiModal Models

API to infer automated disease detection and report generation from medical images.

MultiCLIP: A framework for multimodal-multilabel-multistage classification utilizing advanced pretrained models like CLIP and BLIP. 一个多模态多标签多阶段分类框架，利用像CLIP和BLIP这样的先进预训练模型。

The most popular databases used in multimodal emotion recognition with a focus on the representation of emotion ambiguity.

We propose a holistic framework that formalizes a dual interpretable mechanism, comprising universal skew-layer alignment and bootstrapping sparsity, to enhance fusion gain in hybrid neural networks.

This project aims on developing a Multimodal data such as Text, Speech and Image for Emotion Recognition in Social Media Content and improve the accuracy of Emotion Recognition.

Unified Clinical Vocabulary Embeddings for Advancing Precision Medicine

A repository for the article "Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora" published in Digital Scholarship in the Humanities (2022)

Reducing Multimodal Alignment to Text-Based, Unimodal Alignment

Visual Question Answering project as a part of 11-777 course requirements

Sports Casting App adapted to "intelligent" living room. Multimodalities are supported.

A curated list of awesome Image captioning strudies, aimed at annotating and reporting CT / MRI scans

Multi-learning

A Multi-Module Star Wars Application that uses swapi.dev for network fetch and Room Database for Local caching.

A repository for the article "Corpus-based insights into multimodality and genre in primary school science diagrams" published in Visual Communication (2023)

MVA Project : Geometric Data Analysis

This repository briefly describes the statistical analyses conducted on tourism corpora consisting of digital photographs shared by English-speaking, popular travel boards on Instagram and official websites. It includes the code used to perform each analysis.