Skip to content

sys1rust 0.1.0-rc1

Pre-release
Pre-release

Choose a tag to compare

View all tags
@github-actions github-actions released this 07 Oct 22:54
v0.1.0-rc1
e348fbd
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • bench: harness, contender adapters and shared environment by @krishhgg in #1
  • bench: workloads and upstream reference answers by @krishhgg in #2
  • bench: stage scripts and analysis tools from the spike and speed rounds by @krishhgg in #3
  • docs: research reports on models, runtimes, Rust and Apple silicon by @krishhgg in #4
  • docs: bake-off report, synthesis, spike, server and speed results by @krishhgg in #5
  • runtime: vendor mlx-sys 0.6.0 with a build that can link a prebuilt MLX by @krishhgg in #6
  • laya-core: model config, weights and checkpoint resolution by @krishhgg in #7
  • laya-core: question parsing and tokenizer by @krishhgg in #8
  • laya-core: backend trait and sequence builder by @krishhgg in #9
  • laya-core: answer decoding and the action head by @krishhgg in #10
  • laya-core: Agent, test backend and fixture parity tests by @krishhgg in #11
  • laya-mlx: the MLX backend by @krishhgg in #12
  • sys1-bench: bench adapter and probe by @krishhgg in #13
  • sys1d: configuration and request validation by @krishhgg in #14
  • sys1d: inference worker and HTTP server by @krishhgg in #15
  • sys1d: live end-to-end test against the real model by @krishhgg in #16
  • laya-mlx: dense local attention, head pruning and unpadding (off by default) by @krishhgg in #17
  • sys1d: make the speed settings the default by @krishhgg in #18
  • docs: README with status, supported models, build and run by @krishhgg in #19
  • Rewrite the README with diagrams by @krishhgg in #20
  • README: call 17 ms inference time; 401 only when a key is set by @krishhgg in #21
  • Greptile: review rules for custom Metal kernels and mlx-sys calls by @krishhgg in #22
  • laya-mlx: wrapper for MLX custom Metal kernels through mlx-sys by @krishhgg in #23
  • laya-mlx: fuserope, one kernel for the qkv split, RoPE and unpad expand by @krishhgg in #24
  • sys1d: fuserope in the default settings, round 2 of SPEED.md by @krishhgg in #25
  • README: speed numbers from round 2 by @krishhgg in #26
  • REPORT.md: the powermetrics sudo rule is removed by @krishhgg in #27
  • laya-mlx: banded local attention (band=N), off by default by @krishhgg in #28
  • laya-mlx: NAX gemm kernels (nax=all), off by default by @krishhgg in #29
  • laya-mlx: fast loading settings (directload, sharehead, parallel_load), off by default by @krishhgg in #30
  • sys1d: round 3 defaults (band=512, nax=all, loading settings, MLX_MAX_MB_PER_BUFFER=10) by @krishhgg in #31
  • README: speed numbers from round 3 by @krishhgg in #32
  • README: open with the speed chart by @krishhgg in #33
  • Rename sys1d to sys1rust and add serve and models subcommands by @krishhgg in #34
  • Download Laya models into the Hugging Face cache by @krishhgg in #35
  • Release bundles, smoke test, Homebrew formula and release workflow by @krishhgg in #36
  • README: install with Homebrew by @krishhgg in #37
  • Install sys1rust from GitHub Releases and remove Homebrew by @krishhgg in #38
  • Guide coding agents through sys1rust setup and use by @krishhgg in #39

New Contributors

Full Changelog: https://github.com/krishhgg/sys1rust/commits/v0.1.0-rc1

Contributors

krishhgg
Assets 5
Loading