KevKibe / Finetuning-Llama2-with-QLoRA Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

This is an implementation of fine-tuning the Llama-2 model with the QLoRA (Quantized LoRA) framework using a specific version of Llama and a particular dataset all from HuggingFace Hub.

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
FineTuning_Llama2_with_QLoRA.ipynb		FineTuning_Llama2_with_QLoRA.ipynb
README.md		README.md

Repository files navigation

Finetuning-Llama2-with-QLoRA

Version of Llama Used https://huggingface.co/NousResearch/Llama-2-7b-chat-hf
Dataset used for Finetuning https://huggingface.co/datasets/mlabonne/guanaco-llama2-1k
Finetuning was performed on Google Colab with T4 GPU runtime enabled.

About

This is an implementation of fine-tuning the Llama-2 model with the QLoRA (Quantized LoRA) framework using a specific version of Llama and a particular dataset all from HuggingFace Hub.

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%