Finetune any model with unparalled performance, speed, and reliability using Qlora, BNB, Lora, Peft in less than 30 seconds, just press GO.

🤝 Schedule a 1-on-1 Session

Book a 1-on-1 Session with Kye, the Creator, to discuss any issues, provide feedback, or explore how we can improve Zeta for you.

---

📦 Installation 📦

$ pip3 install ft-suite

---

🚀 Quick Start 🚀

Finetuning

from fts import FineTuner

# Initialize the fine tuner
model_id="google/flan-t5-xxl"
dataset_name = "samsung"

tuner = FineTuner(
    model_id=model_id,
    dataset_name=dataset_name,
    max_length=150,
    lora_r=16,
    lora_alpha=32,
    quantize=True
)

# Generate content
prompt_text = "Summarize this idea for me."
print(tuner(prompt_text))

---

Inference

from fts import Inference

model = Inference(
    model_id="georgesung/llama2_7b_chat_uncensored",
    quantized=True
)

model.run("What is your name")

GPTQ Inference

from fts import GPTQInference


model_id = "facebook/opt-125m"
model = GPTQInference(model_id=model_id, max_length=400)

prompt = "in a land far far away"
result = model.run(prompt)
print(result)

---

🎉 Features 🎉

• World-Class Quantization: Get the most out of your models with top-tier performance and preserved accuracy! 🏋️‍♂️

• Automated PEFT: Simplify your workflow! Let our toolkit handle the optimizations. 🛠️

• LoRA Configuration: Dive into the potential of flexible LoRA configurations, a game-changer for performance! 🌌

• Seamless Integration: Designed to work seamlessly with popular models like LLAMA, Falcon, and more! 🤖

---

🛣️ Roadmap 🛣️

Here's a sneak peek into our ambitious roadmap! We're always evolving, and your feedback and contributions can shape our journey! ✨

• More Example Scripts:

  • Using GPT models
  • Transfer learning examples
  • Real-world application samples

• Polymorphic Preprocessing Function:

  • Design a function to handle diverse datasets
  • Integrate with known dataset structures from popular sources
  • Custom dataset blueprint for user-defined structures

• Extended Model Support:

  • Integration with Lama, Falcon, etc.
  • Support for non-English models

• Comprehensive Documentation:

  • Detailed usage guide
  • Best practices for fine-tuning
  • Benchmarks for quantization and LoRA features

• Interactive Web Interface:

  • GUI for easy fine-tuning
  • Visualization tools for model insights

• Advanced Features:

  • Integration with other quantization techniques
  • Support for more task types beyond text generation
  • Model debugging and introspection tools
  • Integrate TRLX from Carper

... And so much more coming up!

---

💌 Feedback & Contributions 💌

We're excited about the journey ahead and would love to have you with us! For feedback, suggestions, or contributions, feel free to open an issue or a pull request. Let's shape the future of fine-tuning together! 🌱

---

📜 License 📜

MIT

---

Share the Love! 💙

Spread the message of the Finetuning-Suite, this is an foundational tool to help everyone quantize and finetune state of the art models.

Sharing the project helps us reach more people who could benefit from it, and it motivates us to continue developing and improving the suite.

Click the buttons below to share Finetuning-Suite on your favorite social media platforms:

• Share on Twitter

• Share on Facebook

• Share on LinkedIn

• Share on Reddit

Also, we'd love to see how you're using Finetuning-Suite! Share your projects and experiences with us by tagging us on Twitter @finetuning-suite.

Lastly, don't forget to ⭐️ the repository if you find it useful. Your support means a lot to us! Thank you! 💙

---