Skip to content

Releases: mjbommar/glaurung

DecBench sample-set results (fb4ee6b)

Choose a tag to compare

@mjbommar mjbommar released this 13 Aug 21:33

Deterministic DecBench sample-set artifact generated from Glaurung revision fb4ee6b. Covers 224/224 binaries and 250/250 requested functions with zero extraction failures.

DecBench submission e2cb1f3

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 02:08

Deterministic raw Glaurung DecBench sample-set submission built from e2cb1f3. Validated coverage: 224/224 binaries and 250/250 functions with zero extraction failures. SHA-256: c547b228470d904d3ab3fe10f5f331c1d4513acbc7e4120e52fef231a7090944.

DecBench submission e110a0a

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 05:38

Fresh external-eval-kit submission from commit e110a0a8555e891ef421e804e7af796a539532a6.

  • Coverage: 250/250 functions across 224/224 binaries
  • Failures: 0
  • Artifact SHA-256: b0553c6308ab5a5cf7cec5f89d78d1aafb2a55d5c95e7446ecb391c2ffa24aca
  • Projected accepted-ledger union: 80/250 (32.0%)
  • Projected TypeMatch: 0.238814
  • GED: unchanged at 22.621400
  • Corrected ByteMatch: at least 0.304416, with two positive paired row deltas and no regression

The leaderboard values are projections from cache-disabled paired scoring. The official board remains unchanged until DecBench PR #56 is merged and evaluated upstream.

DecBench b50ba50

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 11:47

Exact optimized 224-binary / 250-function external-eval replay for b50ba50. Emits 250/250 functions with zero failures. SHA-256: 7ee0394df4a9c9eeddf86d4b980c66b82d50346592a0009b100aa53cec4ffc69.

DecBench submission 9d76321

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 08:53

Exact-revision Glaurung DecBench submission. Optimized 12-worker replay: 224/224 binaries, 250/250 functions, zero failures. Archive SHA-256: ed7aee876d7eb0eca8c4ac523a69c8a758ba7b579d12533b994341ad4b0ab499.

DecBench raw results 7b4cc50

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 00:29

Deterministic raw DecBench sample-set extraction from Glaurung 7b4cc50. Covers 224/224 binaries and 250/250 functions with zero extraction failures. SHA-256: 17039cf9958df1d2c3a27a328312c47c03830bc4fd7b68cc12ab553a2cbd86f0.

DecBench raw results 399d464

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 07:14

Exact optimized replay of Glaurung 399d464. Coverage: 224/224 binaries, 250/250 functions, zero extraction failures. Archive SHA-256: 85864103bd7cbbe94010db4469337a783ca02aa43c832993d9b289b580a3d15e. This increment corrects one DWARF-confirmed function return type and is score-neutral because DecBench TypeMatch does not score function returns.

DecBench submission 2c16afb

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 04:26

Fresh deterministic DecBench raw submission from Glaurung revision 2c16afbffcc69c90baad9e429f89ad7e8307b5e8.

Validation:

  • official sample set: 224/224 binaries and 250/250 functions
  • extraction failures: 0
  • elapsed wall time: 65.098 seconds
  • package validator and unzip -t: clean
  • archive SHA-256: a823c5b3cfd09ed2e7cc2c3ebc5992646af638896a42024f7e1e951859a91057
  • generated C is byte-identical to the independently replayed candidate

This increment recovers the eighth ssh_agent_sign parameter from independent direct callers. Paired local scoring is neutral on GED, TypeMatch, and corrected ByteMatch; the benefit is source arity correctness and shared cached unwind indexing.

DecBench submission 1e973bc

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 09:53

Fresh optimized DecBench sample-set submission from Glaurung revision 1e973bc.

  • 224/224 binaries
  • 250/250 functions
  • zero extraction failures
  • 12 workers, 8-second analysis timeout
  • 52.674 seconds wall; 2.781 mean, 2.442 median, 3.961 p95, 4.405 maximum seconds per binary
  • archive SHA-256: c00c0bb020c96b1d5e28d20741a7344aa07c263e81d48026681bb755910d3d0b

Relative to 9d76321, only CMSIS-DAP main and FreeRTOS Default_Handler change; the other 222 generated C files are byte-identical.

DecBench 020dede

Choose a tag to compare

@mjbommar mjbommar released this 11 Aug 16:07

Exact reproducible DecBench external-submission artifact for Glaurung revision 020dede. Fresh optimized extraction covered 224/224 binaries and 250/250 functions with zero failures. The archive passed package validation and zip integrity checks. SHA-256: c5c5a8978760961c6be240e6f25af5ab1b9b859c99bbd2d88f552bfaaf4de3dd.