laguna §2: fold in #5's corrected kwarg model + the revision-dependent default#7
Conversation
I merged a fourth stack's findings straight to main without review. Backing that out: it is the weakest-sourced item in the set (relayed via screenshot, no published raw data, unlike BlackwellBoy's lab repo and Defilan's harness) and it CONTESTS this guide's headline recommendation, which is exactly the kind of claim that should be reviewed and independently tested before it lands. Removed from main pending #8: the regime-split thinking claim (+2.6 pts on single-turn codegen), the ~12k budget / cap-hits-are-degeneration-loops guidance, the related blind-spot chip, and the fourth-stack credit. Quickstart #1 and #4 and the card thinking row revert to the reviewed (#7) wording, with a pointer to the open PR. Retained on main, because they came from contributors with published data who are also the reviewers: the dose-curve reframe of the firing gate, the closed open question, the truncated-think failure mode, and the gfx1151 serving config.
|
Thanks for merging. Checked the merged patch against what we sent and it landed verbatim, no changes needed on our side. Worth noting the correction chain this closes: our §2 line was itself downstream of Defilan's #5 walk-back of his own earlier finding, so the guide has now been corrected twice in the same direction by two different stacks disagreeing with themselves. That is a good sign about the process rather than a bad one about the data. One knock-on you may already have in hand: with |
Follow-through on #5, since §2 on main still carries the 07-25 model it superseded. Scope kept minimal: the §2 control bullet, quickstart row 1, minimize-thinking rank 1, and a changelog entry.
What changed:
falseis a real structural off-switch (pre-closed</think>, 0/15 at a fixed budget); omitting the kwarg is not thefalsepath (the absent arm renders byte-identical totrueon the tested llama.cpp stack, the server supplies the value sodefault(false)never runs, and the model reasons about half the time). Added the revision-dependence from our stack: the rev0761412NVFP4 checkpoint's on-disk template (and Poolside's current HF upload) defaultenable_thinkingtotrue, so which arm "absent" lands in moves with the revision; the standing advice becomes send the kwarg explicitly and verify your own rendering (pointer to #6's render_check). The old advice is recorded as wrong in the changelog rather than quietly edited.Deliberately not folded in: #5's re-measured persona-gate magnitude (10/18 vs 1/18) and the restored task-shape signal; how to weigh those across §2 and §5e is your call.
check_guides.pypasses.Drafted with AI assistance (Claude); reviewed and submitted by @Blackwellboy.
Happy to adjust scope or drop this if you'd rather fold #5 in your own way.