Jayveersinh-Raj / LoRA_implementation Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

This is the implementation of low rank adaptation (LoRA) which is a subset of parameter efficient fine tuning (PEFT).

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
LoRA_Implementation.ipynb		LoRA_Implementation.ipynb
README.md		README.md

Repository files navigation

Low Rank Adaptation (LoRA) implementation

This is the implementation of low rank adaptation (LoRA) which is a subset of parameter efficient fine tuning (PEFT).

Papers references:

Effectiveness of Language Model Fine-Tuning

Intrinsic Dimensionality Paper

About

This is the implementation of low rank adaptation (LoRA) which is a subset of parameter efficient fine tuning (PEFT).

lora language-model causal-inference causal-models fine-tuning peft huggingface huggingface-transformers causal-language-modeling

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%