v0.0.1-rc13

v0.0.1-rc13

Diagnostic release for MTP observability.

Summary

• Add MTP throughput benchmark diagnostics.
• Expose read-only MTP config diagnostics in /props.
• Expose read-only MTP timing diagnostics in /props.
• Expose read-only MTP validate-efficiency diagnostics in /props.
• Fix unit fake MTP bindings after validate-efficiency diagnostics.

MTP diagnostics

This RC adds observability for:

• mtp_last_completion
• mtp_config
• mtp_last_timing
• mtp_last_validate_efficiency

These diagnostics make it possible to inspect:

• draft/accepted/rejected token counts
• acceptance ratio
• target/draft decode calls
• MTP config, including effective n_max
• target validate timing
• draft generation timing
• checkpoint/restore timing
• estimated validate rows requested, consumed, and wasted

Notes

• This release does not introduce MTP performance optimizations.
• Default MTP behavior remains unchanged.
• n_max=3 remains the default.
• Prior experiments with n_max=2 and n_max=4 did not improve the tested CPU-only medium-chat workload.
• Current diagnostics show target validation as the dominant observed cost in the tested MTP path.
• Raw trace payloads are not exposed through /props.

Validation

• PYTHONPATH=src python3 -m orbit.native_llama.build_cli --with-mtp-shim
• python3 -m compileall -q src tests scripts
• PYTHONPATH=src python3 -m unittest tests.test_bench_mtp_throughput -q
• PYTHONPATH=src python3 -m unittest tests.test_native_persistent_mtp -q
• PYTHONPATH=src python3 -m unittest tests.test_smoke_harness tests.test_native_mtp_experimental -q
• PYTHONPATH=src python3 -m unittest tests.test_runtime_status tests.test_cli tests.test_repl tests.test_commands -q
• PYTHONPATH=src python3 -m unittest discover -s tests -q
• MTP strict smoke: PASS
• Timeout/cancel recovery smoke: PASS
• git diff --check