Skip to content

v0.4.1

Choose a tag to compare

@github-actions github-actions released this 03 Sep 19:01
· 81 commits to main since this release
v0.4.1
b906a2a

What's Changed

  • The first map_to_host in a process costs 1.3 GiB by @tamnd in #175
  • Give back each tensor's pages once the card has them by @tamnd in #176
  • The research on using MAX instead of rolling our own by @tamnd in #177
  • Bound how far the read stage gets ahead of the drain loop by @tamnd in #178
  • docs: one byte per weight is the memory problem and half the throughput problem by @tamnd in #179
  • fix: the macOS memory column hid whichever weights the engine held by @tamnd in #184
  • perf: pack the planar quant plane at four bits by @tamnd in #185
  • docs: there is no map_to_host arena on Metal by @tamnd in #188
  • chore: release 0.4.1 by @tamnd in #187

Full Changelog: v0.4.0...v0.4.1