Skip to content

HaloFPX v1.4.0 — Ollama-Compatible API

Choose a tag to compare

View all tags
@julianmb julianmb released this 21 Aug 11:40
· 58 commits to main since this release
v1.4.0
f3a260d

Highlights

🦙 Drop-In Ollama Compatibility

halofpx now exposes Ollama's core API surface — existing Ollama clients and tools work without changes:

export OLLAMA_HOST=http://localhost:8010
ollama list
ollama run ornith-1.5-35b:latest "Say hi"
Endpoint Behavior
GET /api/version Server version
GET /api/tags Active model first + full zoo, with size/digest/quantization metadata
POST /api/chat Streaming NDJSON and non-streaming
POST /api/generate Same, with Ollama response semantics
  • Ollama options mapped: num_predict, temperature, top_p, seed, stop
  • Guards: 503 when no model is loaded, 409 when the requested model differs from the active one (no silent wrong-weights answers)
  • Token stats counted client-side; engine usage honored when provided

Validated end-to-end against live Ornith-1.5-35B ROCmFP4 on gfx1151 (streaming NDJSON shape, non-streaming completions, model-mismatch rejection).

🧪 Tests

Suite grew to 33 tests, including SSE→NDJSON translation coverage with a mocked engine.

Full changelog: v1.3.0...v1.4.0

Assets 2
Loading