Skip to content

StaleyNET v0.1.2

Latest
Latest

Choose a tag to compare

View all tags
@arpanpathak arpanpathak released this 04 Nov 08:14
· 82 commits to main since this release
v0.1.2
b1c8ac4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

StaleyNET v0.1.2

Highlights

  • A crate page for newcomers. staleynet-audio 0.1.2 is on crates.io.
    • Its page explains decoding, resampling, the log-mel spectrogram and Griffin-Lim reconstruction by intuition first.
    • It has five examples, and every one runs as a documentation test.
    • It links to the paper, the book chapters and the background literature.
  • GPU kernels organised by topic (#35, #36).
    • There is one module per topic: matrix products, attention, loss, optimizer, element-wise operations, normalization, embeddings and signal processing.
    • Long argument lists are replaced by small documented structures.
    • Writes go through two bounds-checked helpers.
  • Current cuda-oxide (#34). The AGX Thor builds against cuda-oxide's main branch on Rust 1.99.1, and the Orin NX keeps its older revision through a local override. One code path serves both.
  • Revised paper (#38).
    • The text is plainer and more modest, and every quantity carries its unit.
    • Procedures state their inputs and outputs.
    • A new appendix covers hardware (including the AGX Thor's 128 GB), benchmarks and the tokenizer study.
    • The book's GPU chapter describes the new kernel layout.
  • Safer remote sync (#37). deploy/thor/sync.sh no longer deletes caches that exist only on the remote machine.
  • New artifacts.
    • The private Hugging Face repositories now hold the lyrics-thor, lyrics-thor-long and pq-large runs. pq-large is a 42.9 M-parameter model on the band-group tokenizer, uploaded as a snapshot at step 7,000.
    • They also hold the band-group token caches.
    • artifacts/ records their checksums and metadata.

Install the audio crate

cargo add staleynet-audio

Crates.io status

staleynet-audio is published. The other crates remain source-only because they depend on cuda-oxide's cuda-device and cuda-host, which are distributed only through Git, and crates.io does not accept Git dependencies.

Verification

  • CI: rustfmt, clippy with warnings denied, tests, cargo-deny and the audio coverage gate pass.
  • Audio crate: 40 unit tests and 5 documentation tests pass.
  • GPU crates, on both the Jetson Orin NX (cuda-oxide b7fe543) and the Jetson AGX Thor (cuda-oxide 2ffc19b):
    • staleynet-cuda: 31 unit and 9 integration tests pass;
    • staleynet-model: 32 and 6 pass;
    • staleynet-data: 27 and 3 pass.
Assets 2
Loading