Skip to content

v0.7.4

Choose a tag to compare

@github-actions github-actions released this 01 Jun 17:19
· 32 commits to main since this release

Fixed

  • bench.rs TOTAL aggregate was dragged down by error fixtures — when a fixture timed out or failed, its wall_ms was still summed into the aggregate even though its completion-token count was absent. The aggregate tok/s now skips error rows. Reviewer-flagged by Mikasa.
  • OpenAI-mode tok/s was not labelled as wall-clock-derived — Ollama-native mode computes tok/s from eval_duration (decode only), while OpenAI-compat mode divides by wall_ms (which includes TTFT and transit). The column header now shows tok/s* in OpenAI mode and a footnote explains the difference, so readers don't conclude OpenAI backends are slower than they actually are. Reviewer-flagged by Mikasa.

Changed

  • bench::Fixture gains an Option<&'static str> system_prompt field — decode-heavy fixtures (explain_concept, summarize) now run without a "concise" system prompt so they produce enough tokens to make the timing meaningful. Other fixtures keep a tight prompt because they're intentionally short. Reviewer-flagged by Mikasa.

Internal

  • engine.rs user-message path — removed a dead inner if user_images.is_empty() inside the OpenAI-compat else arm. The outer branch already guarantees the slice is non-empty there; the inner check could never fire. Reviewer-flagged by Eren.