Repository navigation
v1.1.0
Release Notes — v1.1.0: Fine-Tuning & Model Customization
🌟 Highlights
Distillery now supports full LLM fine-tuning — take your datasets, train custom models on GPU, and deploy them through the platform. This release turns Distillery from a model-serving tool into a complete training-to-deployment platform.
🚀 New Features
Fine-Tuning Pipeline
- End-to-end fine-tuning workflow: define datasets → configure training → run GPU-accelerated training → export → deploy
- Local training engine with robust GGUF support (quantization, tensor mapping, metadata, progress tracking)
- New JSONL dataset format support
- Qwen3 RoPE encoding repair utility
Model Store
- Manage your trained and base models: upload, download, list, and delete
- Transfer models between local and remote storage
- Model selection for training and deployment
Agent Capabilities
- New coding agent with pluggable LLM providers
- Reflection agent for iterative self-improvement
- Extensible typed tool registry
- Code parsing utilities for source-level analysis
Web UI
- New agent configuration page
- Model store management page
- Enhanced dashboard
🛠️ Improvements & Infrastructure
| Area | Description |
|---|---|
| Data Store | Expanded schema: agents, fine-tunes, model store, deployments, tasks, training |
| Code Quality | Significantly improved linter configuration; exhaustive struct checks |
| Containerization | Updated Dockerfile and Makefile for new components |
| Testing | +29k lines of test coverage across all layers |
| Tooling | Pull-models script for automated model downloads |
🧩 Breaking Changes
Note: This is a v1.1.0 release; consider the following when upgrading:
- Data store schema (
data/distillery.json) has been extended significantly. On first run with new data, existing stores may need migration or re-initialization. - Makefile targets and build commands may have changed — review
make help. - HTTP API routes were reorganized (new handlers for agents, models, fine-tunes). Update any external API integrations accordingly.
📦 Installation / Upgrade
git pull origin feature/fine-tuning
make build # or follow README instructions
make runFor GPU training, see the new trainer/ directory instructions in README.md.
🔧 Known Issues / Notes
- Fine-tuning requires a compatible NVIDIA GPU for best performance (CPU fallback available but slow)
- Large dataset files (>1GB) may take time to parse; consider streaming formats
- GGUF export is verified for Qwen-family models; other architectures may need additional tuning
✅ What's Next
- Multi-GPU distributed training
- Cloud storage integration (S3-compatible)
- Hyperparameter sweeps / auto-tuning
- Dataset versioning and lineage tracking