Skip to content

Releases

hbench v0.3.13

Choose a tag to compare

@github-actions github-actions released this 09 Nov 03:55
2969fcb

What's Changed

  • viewer: use the Hbench mark as the logo by @luiyen in #77
  • CI: run the e2e suite's three parts in parallel by @rzonyx in #80
  • run wizard: self-hosted model server option; viewer logo by @luiyen in #82
  • Release 0.3.13 by @luiyen in #83

Full Changelog: v0.3.12...v0.3.13

hbench v0.3.12

Choose a tag to compare

@github-actions github-actions released this 02 Nov 16:59
f7ed0e3

What's Changed

  • Pull OCI datasets with the docker config's credentials by @rzonyx in #78
  • Release 0.3.12 by @rzonyx in #79

Full Changelog: v0.3.11...v0.3.12

hbench v0.3.11

Choose a tag to compare

@github-actions github-actions released this 31 Oct 12:53
0939c54

What's Changed

Full Changelog: v0.3.10...v0.3.11

hbench v0.3.10

Choose a tag to compare

@github-actions github-actions released this 31 Oct 08:06
8b61ffb

What's Changed

  • viewer: Map tab for a trial's trajectory by @luiyen in #72
  • Live trajectories in hbench view, and keep the session of timed-out deepseek-harness runs by @luiyen in #70
  • Release 0.3.10 by @rzonyx in #73

Full Changelog: v0.3.9...v0.3.10

hbench v0.3.9

Choose a tag to compare

@github-actions github-actions released this 28 Oct 16:58
77cff94

What's Changed

Full Changelog: v0.3.8...v0.3.9

hbench v0.3.8

Choose a tag to compare

@github-actions github-actions released this 27 Oct 07:59
9e28fbf

What's Changed

  • e2e covers every hbench command by @luiyen in #60
  • Installer: read the latest tag from the redirect only by @rzonyx in #64
  • codex writes an ATIF trajectory.json from its rollout by @rzonyx in #61
  • Show a progress line while tasks download by @rzonyx in #65
  • Attest install.sh and SHA256SUMS, document checking the installer by @rzonyx in #62
  • Record the model backend a trial was served by, never its endpoint by @rzonyx in #66
  • Release 0.3.8 by @rzonyx in #68

Full Changelog: v0.3.7...v0.3.8

hbench v0.3.7

Choose a tag to compare

@github-actions github-actions released this 23 Oct 14:06
49e791b

What's Changed

Full Changelog: v0.3.6...v0.3.7

hbench v0.3.6

Choose a tag to compare

@github-actions github-actions released this 23 Oct 12:58
bda2a2e

What's Changed

  • Release faster: one job per binary, CI on the tagged commit gates publishing by @rzonyx in #45
  • Show the hbench logo above the top-level help by @luiyen in #48
  • Fix the high findings from the e2e test review by @luiyen in #47
  • README: the Discord support and announcements channels by @rzonyx in #50
  • README: one line per contact channel by @rzonyx in #51
  • Help names the default registry and jobs verify by @rzonyx in #53
  • README: the Discord links are invites by @rzonyx in #52
  • Ctrl+C: messages no longer run into the status line by @rzonyx in #54
  • Wizard: offer model names the agents take by @rzonyx in #55
  • Add hbench jobs upload: POST a finished job to a server that takes one by @rzonyx in #49
  • Price table: LiteLLM 1.106.2 by @rzonyx in #56
  • Release 0.3.6 by @rzonyx in #57

Full Changelog: v0.3.5...v0.3.6

hbench v0.3.5

Choose a tag to compare

@github-actions github-actions released this 23 Oct 04:46
0402ba6

What's Changed

  • Add -o/--observe: print every trial's log and command output as it runs by @rzonyx in #43
  • Release 0.3.5 by @rzonyx in #44

Full Changelog: v0.3.4...v0.3.5

hbench v0.3.4

Choose a tag to compare

@github-actions github-actions released this 22 Oct 17:45
cdd8195

What's Changed

  • Wizard: keep the flags given on the command line by @rzonyx in #40
  • Release 0.3.4 by @rzonyx in #41

Full Changelog: v0.3.3...v0.3.4