v1.5.3
Improvements:
- Dashboard profile/version selectors - Ability to pick profile and version directly from the dashboard view (PR #41)
- Device memory usage tracking - Added device memory usage tracking to dashboard and model info (PR #40)
Fixes:
- Derive free memory from
total - selfinstead of trusting Vulkan pool accounting - Sum KV cache sizes for MTP models
- Only capture first KV cache line (skip MTP draft context)
- Update device memory in
currentModelfor post-load breakdown lines - Hide unused devices from loaded model memory table
- Handle negative unaccounted in memory breakdown regex
Refactor:
- Reorganize modal files into
ui/specialized/