Skip to content

v0.1

Choose a tag to compare

View all tags
@sysit sysit released this 25 Mar 16:31
· 37 commits to main since this release
v0.1
fef66bc

MLX Service v0.1

Features

  • On-demand model loading with LRU eviction
  • OpenAI + Ollama API compatibility
  • Model type detection from config.json (VL/MoE)
  • Idle auto-unload (default 30 min)

Fixes

  • Ollama API proper error status codes (400/503)
  • Auth whitelist for read-only endpoints

Tested

  • ✅ Health check
  • ✅ Model list (public)
  • ✅ Chat completion
  • ✅ Error status codes
Assets 2
Loading