llm-collections

Misc. collection of files relating to open source LLM and other generative AIs.

Notebooks

Badges	Notebook
	Running Open Source LLM - CPU/GPU-hybrid option via llama.cpp
	Running Open Source LLM - GPU option via exllama
	Fine-tuning LLM using QLora with axolotl
	Merge QLora and Quantize Model

File	Description
axolotl_qlora_example.log	Terminal Log file of example training run of Qlora using axolotl
exllama_modal.py	Running LLM with exllama using modal.com Serverless cloud
wizardcoder_modal.py	Running `WizardCoder` using modal.com Serverless cloud

Name		Name	Last commit message	Last commit date
Latest commit History 35 Commits
.circleci		.circleci
.github/workflows		.github/workflows
ai-video		ai-video
archive		archive
.gitignore		.gitignore
LLM_Finetune_qlora_axolotl.ipynb		LLM_Finetune_qlora_axolotl.ipynb
LLM_Merge_QLora_and_Quantize_Model.ipynb		LLM_Merge_QLora_and_Quantize_Model.ipynb
LLM_exllama_tutorial.ipynb		LLM_exllama_tutorial.ipynb
LLM_llamacpp_tutorial.ipynb		LLM_llamacpp_tutorial.ipynb
README.md		README.md
axolotl_qlora_example.log		axolotl_qlora_example.log
exllama_modal.py		exllama_modal.py
wizardcoder_modal.py		wizardcoder_modal.py