BetterGPT v2.0.2
This release added a sample text generation code after SFT finetuning also focused on bug fixes for SFT model loading sample generation.
Added
- Added SFT sample generation pipline
Fixed
- Fixed minor bugs identified after the v2.0.1 release.
- Resolved edge cases affecting model and training workflows.
Looking Ahead
Planned work for upcoming releases includes:
- Grouped Query Attention (GQA)
- KV Cache for faster autoregressive inference
- Additional training optimizations
- Evaluation benchmarks and model cards
Thank you to everyone using BetterGPT and contributing feedback.