Repository navigation
v0.4.1
What's Changed
- The first map_to_host in a process costs 1.3 GiB by @tamnd in #175
- Give back each tensor's pages once the card has them by @tamnd in #176
- The research on using MAX instead of rolling our own by @tamnd in #177
- Bound how far the read stage gets ahead of the drain loop by @tamnd in #178
- docs: one byte per weight is the memory problem and half the throughput problem by @tamnd in #179
- fix: the macOS memory column hid whichever weights the engine held by @tamnd in #184
- perf: pack the planar quant plane at four bits by @tamnd in #185
- docs: there is no map_to_host arena on Metal by @tamnd in #188
- chore: release 0.4.1 by @tamnd in #187
Full Changelog: v0.4.0...v0.4.1