Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

[NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning

Medical Report Generation And VQA (Adapting XrayGPT to Any Modality)

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Streamline the creation of supervised datasets to facilitate data augmentation for deep learning architectures focused on image captioning. The core framework leverages MiniGPT-4, complemented by the pre-trained Vicuna model, which boasts 13 billion parameters.

Simplified local Windows OS setup of MiniGPT-4 running in an Anaconda environment; includes example local server and client.

MiniGPT-4基于DeepSpeed加速➕ 扩充模型规模 ➕ 实验分析

About Implementation for paper "InstructionGPT-4: A 200-Instruction Paradigm for Fine-Tuning MiniGPT-4" (https://arxiv.org/abs/2308.12067)

ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

MiniGPT-4 : Enhancing Vision-language Understanding with Advanced Large Language Models