Unify Efficient Fine-Tuning of 100+ LLMs

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

✨✨Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Instruction Tuning with GPT-4

Aligning pretrained language models with instruction data generated by themselves.

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

总结Prompt&LLM论文，开源数据&模型，AIGC应用

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！

An Open-sourced Knowledgable Large Language Model Framework.

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

Video Foundation Models & Data for Multimodal Understanding

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Crosslingual Generalization through Multitask Finetuning

DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.