Publish dashboard-data-20260805: Inkling debuts fourth, Qwen3.8-Max twenty-fifth of 29 - #136
Merged
Conversation
…wenty-fifth of 29 Two additions in one board update. Inkling (Thinking Machines Lab's first model, open weights on day one under Apache 2.0) debuts at 83.8 within-$1 — fourth of 29 and the strongest US open-weight model, at $0.098 per household on a forced tool contract that parsed 1,984/1,984. Qwen3.8-Max (GA 2026-08-03, closed until its promised weights appear) debuts at 71.5 — twenty-fifth, below its predecessor Qwen3.7-max (73.6) — on the JSON contract with a 98,304-token completion cap; it reasons 36-40k tokens per whole-scenario request, the heaviest on the roster, and also parsed 1,984/1,984. The payload carries 7,125 decisive judge-annotation rows across 935 cases with zero reference suspects; the strict publish gate passes and all 27 incumbent modelStats are byte-identical to dashboard-data-20260724. The manifest's live artifact entry and audit-annotation sha advance in this commit, the hero snapshot label moves to 2026-08-05, and the leaderboard gains a Thinking Machines provider (icon masked from the company's own favicon so it follows currentColor in both themes). Also updates the gpt-5.6 cost-map test to assert litellm's map-internal price structure instead of equality with PRICE_OVERRIDES_PER_1M: OpenAI cut Terra/Luna prices on 2026-07-30, and the overrides deliberately keep the rates the recorded July runs were billed at so historical costUsd reconstructions stay byte-stable. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Verification
🤖 Generated with Claude Code