Skip to content

v0.5.0 — Ollama 0.32 support + usage-totals fix

Choose a tag to compare

View all tags
@LogneBudo LogneBudo released this 15 Aug 01:12
· 15 commits to master since this release
v0.5.0
97c83bd

Tracks Ollama 0.32, and fixes a token-count regression that arrived with it.

Fixed

Benchmark and Protocol Observatory token counts read zero on Ollama 0.32.6+.

That release aligned /v1/chat/completions with OpenAI's wire format: the final usage totals are now only emitted when the request opts in via stream_options.include_usage. LLMxRay now sends it — and reads the totals from the trailing chunk, which carries an empty choices array, so the read also had to move ahead of the per-choice guard. Restores tokenCount and tokensPerSecond in the Surgical Benchmark, and the OpenAI lane's token count in the Protocol Observatory.

Added

  • Reasoning effort levels — the thinking control offers Off, On, Low, Medium, High and Max, mapping to Ollama's think parameter. On sends true and lets the model choose its own effort; the named levels request an explicit reasoning budget.
  • Embedding dimensions — the Embeddings Lab can request a narrower output vector via dimensions (Matryoshka truncation), with the model's native width as the placeholder.

Changed

  • Capabilities now come from the model listing. Ollama 0.32 reports capabilities, context_length and embedding_length in /api/tags, so capability icons and model filtering are correct as soon as the list loads rather than after a per-model /api/show round-trip. /api/show still enriches parameters, template, license and architecture metadata in the background.
  • A reported capability set is authoritative — if the daemon lists a model's capabilities and omits thinking, that is believed rather than overridden by a name guess. Name patterns apply only to models that report nothing at all.
  • embedding is a first-class capability, replacing the duplicate name-pattern filter the Embeddings page carried separately from the model store.
  • Fallback patterns extended: qwen3.x, muse-glimmer, glm-*, kimi-k* (reasoning), gemma3 (vision).
  • READMEs (EN/FR/ZH/AR/SR) and the Models guide updated for Ollama 0.32.x.

Fixed (i18n)

The thinking control's strings were missing entirely from the Chinese and Arabic catalogs. Both are now complete, alongside the new effort-level and embedding-dimension strings across all six locales.

Install

npx llmxray

docker pull djovaneli/llmxray:0.5.0

Tested against Ollama 0.32.9. Unit tests 190 → 203, covering the usage-chunk shape, capability resolution, and the request bodies that carry the fix.

Assets 2
Loading