Skip to content

CLEAR-LeWM v0.2.0: calibrated three-tier evaluation

Choose a tag to compare

View all tags
@DavidSunok DavidSunok released this 21 Jul 11:42
v0.2.0
7528944

CLEAR-LeWM v0.2.0 establishes a reproducible three-tier LeWM evaluation standard.

Highlights:

  • Official, Moderate, and Strict protocols for PushT, Reacher, TwoRoom, and Cube
  • Fixed 100-pair seed-42 manifests and 24 checked-in random/official-LeWM reference runs
  • All four revision-pinned official checkpoints strictly load 303/303 tensors and remain above random in every tier
  • Corrected task success predicates, episode-balanced sampling, initial-success filtering, and strict difficulty floors
  • Auditable official-checkpoint preparation with source and runtime SHA-256 provenance
  • Corrected FAST memmap loader plus conversion, resume validation, and source-equivalence audit
  • Canonical HDF5/Lance data-format contract and a refreshed protocol GIF/README

Reference SR (Official / Moderate / Strict, official LeWM):

  • PushT: 89% / 74% / 42%
  • Reacher: 87% / 63% / 22%
  • TwoRoom: 85% / 70% / 41%
  • Cube: 62% / 36% / 17%

Validation: 17 tests passed, Ruff clean, wheel build verified.

Assets 3
Loading