Skip to content

v1.1.0

Choose a tag to compare

@Eisenmann Eisenmann released this 20 Sep 16:06
· 17 commits to main since this release
60960c0

Release Notes — v1.1.0: Fine-Tuning & Model Customization

🌟 Highlights

Distillery now supports full LLM fine-tuning — take your datasets, train custom models on GPU, and deploy them through the platform. This release turns Distillery from a model-serving tool into a complete training-to-deployment platform.


🚀 New Features

Fine-Tuning Pipeline

  • End-to-end fine-tuning workflow: define datasets → configure training → run GPU-accelerated training → export → deploy
  • Local training engine with robust GGUF support (quantization, tensor mapping, metadata, progress tracking)
  • New JSONL dataset format support
  • Qwen3 RoPE encoding repair utility

Model Store

  • Manage your trained and base models: upload, download, list, and delete
  • Transfer models between local and remote storage
  • Model selection for training and deployment

Agent Capabilities

  • New coding agent with pluggable LLM providers
  • Reflection agent for iterative self-improvement
  • Extensible typed tool registry
  • Code parsing utilities for source-level analysis

Web UI

  • New agent configuration page
  • Model store management page
  • Enhanced dashboard

🛠️ Improvements & Infrastructure

Area Description
Data Store Expanded schema: agents, fine-tunes, model store, deployments, tasks, training
Code Quality Significantly improved linter configuration; exhaustive struct checks
Containerization Updated Dockerfile and Makefile for new components
Testing +29k lines of test coverage across all layers
Tooling Pull-models script for automated model downloads

🧩 Breaking Changes

Note: This is a v1.1.0 release; consider the following when upgrading:

  • Data store schema (data/distillery.json) has been extended significantly. On first run with new data, existing stores may need migration or re-initialization.
  • Makefile targets and build commands may have changed — review make help.
  • HTTP API routes were reorganized (new handlers for agents, models, fine-tunes). Update any external API integrations accordingly.

📦 Installation / Upgrade

git pull origin feature/fine-tuning
make build        # or follow README instructions
make run

For GPU training, see the new trainer/ directory instructions in README.md.


🔧 Known Issues / Notes

  • Fine-tuning requires a compatible NVIDIA GPU for best performance (CPU fallback available but slow)
  • Large dataset files (>1GB) may take time to parse; consider streaming formats
  • GGUF export is verified for Qwen-family models; other architectures may need additional tuning

✅ What's Next

  • Multi-GPU distributed training
  • Cloud storage integration (S3-compatible)
  • Hyperparameter sweeps / auto-tuning
  • Dataset versioning and lineage tracking