Skip to content

v2.1.4

Choose a tag to compare

View all tags
@github-actions github-actions released this 03 Jul 13:16
· 963 commits to main since this release
v2.1.4
33415f9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

   🚀 Features

  • bench:
  • scaffbench:
    • V2 expansion — core/quality scoring, frontier paths, new ecosystems + batch-1 specs  -  by @Marve10s (24299)
    • Batch-2 specs — java-spring-jooq-keycloak + elixir-broadway-absinthe  -  by @Marve10s (877cc)
    • Batch-3 specs — react-native-expo + 2 frontier (prompt-only) → 14 total  -  by @Marve10s (b6ce0)
  • web:
    • Floating Patreon support button with hover tooltip  -  by @Marve10s (d916c)
    • Refresh contributors list  -  by @Marve10s (16dfe)
    • ScaffBench V2.1 homepage — current run, v2 → legacy  -  by @Marve10s (584f1)
    • ScaffBench 2.1 max-effort results + Claude Sonnet 5  -  by @Marve10s (dddbf)
    • Publish full Opus 4.8 max (13 specs); correct low-vs-max  -  by @Marve10s (306ad)
    • Sonnet 5 max → 9 specs (1/8); fix blog description length  -  by @Marve10s (295ab)
    • Restructure ScaffBench 2.1 blog + add bar-chart visuals  -  by @Marve10s (4aedb)
    • Finalize ScaffBench 2.1 with Sonnet 5's full 13-spec run  -  by @Marve10s (002cf)
    • Add Sonnet 4.6 + Codex Spark (high) to ScaffBench 2.1  -  by @Marve10s (27d04)
    • Add Gemini 3.5 Flash to ScaffBench 2.1 + provider logos  -  by @Marve10s (feca8)
    • Add /run page — reproduce ScaffBench yourself  -  by @Marve10s (7af4a)
    • Hide free-tier models on the benchmark graph by default, add model picker  -  by @Marve10s (81bff)

   🐞 Bug Fixes

  • scaffbench:
    • Price Claude from token usage + raise gen timeout  -  by @Marve10s (d4520)
    • Gate Java/Elixir validators on explicit native profile, not file autodetect  -  by @Marve10s (7c4f7)
    • Marker accuracy — index pom.xml/mix.exs, fix dotnet solo flags, robust markers, gate vacuous-pass guard  -  by @Marve10s (43859)
  • templates:
    • Pin vinext vite to 8.1.0 (8.1.1 breaks RSC dev server)  -  by @Marve10s (8b341)
    • Gate react-router react-query imports to APIs that use them  -  by @Marve10s (a16f8)
    • Wire react-router ts-rest to react-query (parity with tanstack-router)  -  by @Marve10s (11d2d)
    • Pin graphql to 16.x (v17 violates garph/yoga/apollo peers)  -  by @Marve10s (f62a2)
    • Fix fastify + openapi server typecheck (2 errors)  -  by @Marve10s (6e350)
  • web:
    • Restore changelog update widget + add v2.1.3 release  -  by @Marve10s (e9842)
    • Move ScaffBench 'legacy' tag inside the v2 pill  -  by @Marve10s (0945b)
    • Use the four-color Google mark for Gemini rows  -  by @Marve10s (ff370)
    • Commit routeTree.gen.ts with the /run route  -  by @Marve10s (06f8a)
    • Drop unmetered models from the benchmark scatter instead of plotting at 0  -  by @Marve10s (db130)
    View changes on GitHub

Contributors

Marve10s
Assets 2
Loading