Fine tune pipeline

BetterGPT v2.0.0

This release focuses on making the project fully compatible with the Hugging Face ecosystem while introducing an end-to-end supervised fine-tuning workflow.

What's New

Hugging Face Integration

• Added PreTrainedModel compatibility.
• Added custom PretrainedConfig implementation.
• Full support for AutoModel and AutoConfig.
• Models can now be saved, loaded, and shared using standard Hugging Face APIs.

Supervised Fine-Tuning

• Added an Alpaca instruction fine-tuning pipeline.
• Supports training on instruction-following datasets.
• Includes training scripts and configuration for reproducible experiments.

Improvements

• Cleaner project structure for future model development.
• Better interoperability with Hugging Face tooling and downstream applications.
• Foundation laid for future instruction-tuned and chat-oriented models.

Breaking Changes

• Internal model structure has been updated to align with the Hugging Face PreTrainedModel interface.
• Custom loading workflows from previous versions may require migration to the new API.

Looking Ahead

Planned work for upcoming releases includes:

• Grouped Query Attention (GQA)
• Advanced inference features (KV Cache)
• Expanded training optimizations
• Additional fine-tuning methods (LoRA/QLoRA)
• Evaluation benchmarks and model cards

Thank you to everyone following the project and providing feedback.