docs(azure): make the R6 status true to what landed and what is still owed - #275
Merged
Conversation
… owed R6 still read NOT DONE with a work list describing work that merged in #264 and is now serving. Records what landed, what is genuinely still owed (the live end-to-end GLM review, blocked on a 25K token-per-minute Fireworks quota that is an owner portal action; the startup-credit decrement check; the compartment lane's image rebake), and leaves the acceptance sentence unmet because it is.
A verification pass found ten findings against this section, three of them merge-blocking. All ten are addressed here, docs only, one file. The image claim is refuted rather than softened. The current fm-ccm image does carry pi. Config model_image_id names gallery version 1.0.1787092687, whose source managed image img-fm7c799d-ccm-1.0.1787091895 carries the pi-tarball-sha256 and node-tarball-sha256 tags that only a build from the Pi-carrying declaration (#246) can write, its Image Builder run succeeded on 2026-08-18 between 22:26:20Z and 22:36:46Z, after #246 landed on main at 20:51:35Z, and that declaration asserts pi --version against a tracked version twice, before and after the credential purge. The digests match docs/azure-crosscheck/model-image-closure.json for pi-coding-agent 0.84.1 and Node v22.23.2. The old finding was correct about 1.0.1786915905, which the config stopped naming on 2026-08-18, and it was already stale when it was written into docs/azure-crosscheck.md on 2026-08-20. The dangling "ledger M29" provenance is dropped. The operative fact the section omitted is now stated: the lane is off because crosscheck-azure.json has enabled:false. The status line no longer overclaims. BUILT AND SERVING becomes BUILT 2026-08-20 with the fact that matters first: zero GLM reviews have ever completed, six attempts on 2026-08-20 all recorded tool-failure, and the lane's only verdict came from the pi-codex fallback. The current roster state is reflected, including the restored fallback entries with crosscheck-same-model on. Other corrections: 510K tokens was one hour reported as a day, and the measured total is 727,136; the reasoning_effort probe is restated as an unretained observation; the five-tool-turns figure is removed because no run record carries a turn count; both per-minute limits are stated and the token attribution is labelled inference; the account of what killed each attempt is replaced with what the ledger records; the C1 forward reference is dropped; the zeroed GLM cost table is recorded as a spend-visibility gap; the Cost Management implication is dropped while keeping the fact; and three Work items that appeared in neither list are now covered. R9 is left alone: it already says a pi review on the current image is unproven, which stays true and is consistent with the corrected text.
Scope expansion approved by the coordinator: the requirement doc corrected this claim while the component doc it originated in still asserted it, and C1 (merged in #274 while this branch was open) had since built five further claims on top of it. docs/azure-crosscheck.md, where the sentence originated, now records the corrected limit with the evidence chain: the current fm-ccm image carries pi, and the lane is off because crosscheck-azure.json has enabled:false. The 2026-08-16 measurement is kept and attributed, since M29 is not a dangling reference, only one that lives in the owner's mutation ledger outside this repository, which is now said explicitly. Two neighbouring sentences depended on the false one: the instrumentation follow-up described as bound to an image rebake, and the phases paragraph attributing the lane's silence to a missing image capability. Both now name the flag. C1 depended on it five times and one of those dependencies was independently wrong: it stated the operator home has no config/crosscheck-azure.json. The file exists, carries enabled:false, and names a current model_image_id. Also corrected: the status line and order-of-work entry no longer say the phases wait on a rebake; the argument that the 75 minutes cannot have come from a compartment run after 2026-08-16 is withdrawn rather than restated, since its premise was the false claim; and unmeasurable becomes unmeasured, which is a reversible condition. C1's "known contradiction" paragraph is resolved rather than left stale: R6's status line no longer reads NOT DONE. It now carries the correction that matters to C1, which is that GLM has never completed a review, so the pi-codex fallback is what served the one measured run.
ruby-dlee
force-pushed
the
fm/r6-status-true
branch
from
August 20, 2026 15:40
f0add58 to
53d477f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
R6's status line still read
NOT DONEand its Work list still described work that merged in #264. This document's own rule is that every state line is a claim that must be re-checkable before it is relied on, so a stale status is a defect in it.A verification pass then found ten findings against the first version of this rewrite, three merge-blocking. This branch addresses all ten, and then removes the false claim at its source rather than only where it was quoted.
The image claim was wrong, and is refuted rather than softened
The previous text said the
fm-ccmimage carries nopibinary and the Azure-compartment lane needs a rebake. That is refuted:model_image_idhas named gallery version1.0.1787092687since 2026-08-18T22:45Z. It was published 2026-08-18T22:38:08Z from managed imageimg-fm7c799d-ccm-1.0.1787091895.pi-tarball-sha256a69a1859...andnode-tarball-sha256d60acfe0..., matchingdocs/azure-crosscheck/model-image-closure.jsonforpi-coding-agent0.84.1 and Node v22.23.2. Only a build from the Pi-carrying declaration added in feat(crosscheck): carry the Pi reviewer closure in the Azure model image #246 writes those tags; the previous imageimg-fm7c799d-ccm-1.0.0has neither./usr/local/bin/pi --versionagainst a tracked version twice underset -eu, before and after the credential purge, andbin/fm-crosscheck-azure-image.shbuilds only from the tracked declaration at a HEAD already landed on public main, so a build that reached distribution could not have omittedpi.The 2026-08-16 measurement was correct about the previous gallery version
1.0.1786915905. It was already stale when it was written intodocs/azure-crosscheck.mdin #264 on 2026-08-20. Its "ledger M29" citation is kept rather than dropped: it is not dangling, it lives in the owner's mutation ledger outside this repository, which the corrected text now says explicitly.The operative reason the Azure compartment crosscheck lane is not running is that
$FM_HOME/config/crosscheck-azure.jsonhas"enabled": false, an operator flip on 2026-08-20. That flag, not the image, is what stands between the lane and a run.Corrected at the source, and everywhere that depended on it
docs/azure-crosscheck.mdis where the sentence originated and is corrected here, along with two neighbouring sentences that depended on it: the instrumentation follow-up described as "bound to the image rebake", and the phases paragraph attributing the lane's silence to a missing image capability.C1 merged in #274 while this branch was open and had built five further claims on the same premise. All are corrected, and one of them was independently wrong:
config/crosscheck-azure.json)". The file exists, carriesenabled: false, and names a currentmodel_image_id. It is neither absent nor waiting on an image.The R6 status no longer overclaims
BUILT AND SERVINGbecomesBUILT 2026-08-20; no GLM review has ever completed, with the buried fact first: six GLM attempts on 2026-08-20 all recordedtool-failurewith no citations and no execution proof, a seventh sits in the archived ledger, and the lane's only verdict came from the pi-codex fallback. The current roster state is reflected, including the restored fallback entries withconfig/crosscheck-same-modelon as the sanctioned degraded mode.Other corrections
reasoning_effortprobe is restated as an unretained observation; no request or response capture exists.reviewer_turn_countin the ledger is on the codex fallback run.costtable (tests/fm-crosscheck.test.sh:1046) is recorded as a spend-visibility gap: the ledger records no per-review cost for the new primary reviewer, which is the same ledger R10'sdaily_budget_usdwaits on.bin/fm-crosscheck.pyexposes onlyrun,verify,merge), the unverifiedreasoning_contenttolerance, and review guards never re-sized for a 1M-token model.R9 is deliberately left alone. It already says a pi review on the current model image is unproven, which stays true and is consistent with the corrected text: the binary being present and a review completing are separate claims.
Verification
Docs only, two files; no code paths touched. Rebased onto main after #274 merged. The image findings come from read-only
az sig image-version show,az image list, and image-template run status against galleryfmcellgallery/ definitionfm-ccm; the token and error figures from read-onlyaz monitor metrics listonaif-fm7c799d-eus01; the per-attempt outcomes from the retained crosscheck ledgers. No Azure resource was created, modified, or deleted.