✨✨Latest Advances on Multimodal Large Language Models
-
Updated
Jul 22, 2024
✨✨Latest Advances on Multimodal Large Language Models
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
BigCodeBench: The Next Generation of HumanEval
EVE: Encoder-Free Vision-Language Models from BAAI
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
Code and documentation to train Stanford's Alpaca models, and generate the data.
This repo contains a list of channels and sources from where LLMs should be learned
Must-read Papers on LLM Agents.
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
An Open-sourced Knowledgable Large Language Model Framework.
EditWorld: Simulating World Dynamics for Instruction-Following Image Editing
[Arxiv 2024] Official Implementation of the paper: "Towards Robust Instruction Tuning on Multimodal Large Language Models"
Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
The offical Implementation of "Instruction-Guided Visual Masking"
Is In-Context Learning Sufficient for Instruction Following in LLMs?
Code for "FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (ACL 2024)"
[NeurIPS'23] "MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing".
[ICLR 2024] Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models
Awesome Instruction Editing. Image and Media Editing with Human Instructions. Instruction-Guided Image and Media Editing.
Add a description, image, and links to the instruction-following topic page so that developers can more easily learn about it.
To associate your repository with the instruction-following topic, visit your repo's landing page and select "manage topics."