A Unified Library for Parameter-Efficient and Modular Transfer Learning

A curated list of prompt-based paper in computer vision and vision-language learning.

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.

Research Trends in LLM-guided Multimodal Learning.

[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

On Transferability of Prompt Tuning for Natural Language Processing

Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning

Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"

[ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass

[NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model

[ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"

[Preprint] AdaVAE: Exploring Adaptive GPT-2s in VAEs for Language Modeling PyTorch Implementation

Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022

[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval

Multi-domain Recommendation with Adapter Tuning

[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"

This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!

KR3: Korean Restaurant Review with Ratings / Experiments on Parameter-efficient Tuning and Task-adaptive Pre-training