Skip to content

v0.0.1-rc16

Pre-release
Pre-release

Choose a tag to compare

View all tags
@guelfoweb guelfoweb released this 08 Jul 07:43
v0.0.1-rc16
a6133c3

v0.0.1-rc16

CPU-first usability and benchmark reproducibility release.

Summary

  • Increase the dedicated system_info final budget to avoid truncated hardware/spec answers.
  • Clarify CPU-first native server documentation and optional MTP usage.
  • Add a metadata header to orbit bench-core for reproducible benchmark context.
  • Document bench/profile guidance and conservative server profile suggestions.
  • Move the MTP draft model download out of the base install flow and into the optional MTP section.

Runtime behavior

system_info now has a dedicated final-from-tool output budget.

This avoids truncated answers for prompts such as:

tell me specs about this computer

Observed smoke result:

  • before: tks 287->96, stop: length, /continue required
  • after: tks 289->137, stop: stop, no /continue

This change is scoped to system_info. Small shell, grep, and unknown final budgets remain unchanged.

Documentation

The README now presents the default server path as:

orbit server

Native MTP remains explicit:

orbit server --mtp

The MTP draft model download is documented only in the optional MTP section. The base install flow downloads only the main Gemma model and the multimodal projection model.

Benchmarks

orbit bench-core now prints a metadata header by default, including:

  • Orbit commit/tag
  • Orbit binary path
  • base URL
  • workdir
  • timeout and max tokens
  • Python/platform
  • selected Orbit environment variables
  • best-effort backend /props fields when available

Use --no-metadata to restore minimal benchmark output.

MTP status

MTP remains optional and diagnostic/experimental for performance work.

Validated:

  • MTP strict smoke: PASS
  • timeout/cancel recovery smoke: PASS
  • final /props: mtp_enabled=true, mtp_initialized=true, mtp_failure_reason=null, in_flight=false

Validation

  • Targeted unit gates: PASS
  • Full unit gate: PASS, 980 tests
  • system_info smoke: PASS
  • bench-core metadata smoke: PASS
  • evidence lineage clean smoke: PASS
  • KV/final token reduction smoke: PASS
  • MTP strict smoke: PASS
  • timeout/cancel recovery smoke: PASS
  • git diff --check: PASS
Assets 2
Loading