Skip to content

v0.7.10

Choose a tag to compare

View all tags
@dahai80 dahai80 released this 06 Aug 00:36
v0.7.10
62f117b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Fixed

  • #373 - Dead guided-decoding branch on /v1/responses. Removed the use_guided / engine.generate_with_schema / engine.supports_guided_generation references from fusion_mlx/routes_internal/responses.py (_resolve_strict_context and the _non_stream dispatch). No engine class defines those symbols — the branch was dead code and a latent AttributeError. Strict json_schema requests on /v1/responses now go straight to the R12-4 post-generate validation path (the only live constrained path on this buffered-only surface). Live constrained decoding for the chat surface runs through the grammar-compiler (xgrammar/llguidance) path in openai_routes.py, unchanged.

Removed

  • tests/unit/test_responses_chat_template_kwargs.py: deleted the TestBatchedEngineGuidedHonorsEnableThinking class (3 dead-contract tests) and test_strict_via_guided_path_also_auto_disables; simplified the _Engine mock. 15 tests remain green.

Full changelog: https://github.com/dahai80/fusion-mlx/blob/main/CHANGELOG.md

Assets 2
Loading