Skip to content

v1.5.3

Choose a tag to compare

@bayger bayger released this 30 Jun 16:50
b019079

Improvements:

  • Dashboard profile/version selectors - Ability to pick profile and version directly from the dashboard view (PR #41)
  • Device memory usage tracking - Added device memory usage tracking to dashboard and model info (PR #40)

Fixes:

  • Derive free memory from total - self instead of trusting Vulkan pool accounting
  • Sum KV cache sizes for MTP models
  • Only capture first KV cache line (skip MTP draft context)
  • Update device memory in currentModel for post-load breakdown lines
  • Hide unused devices from loaded model memory table
  • Handle negative unaccounted in memory breakdown regex

Refactor:

  • Reorganize modal files into ui/specialized/