TrnRT v0.1.0

What's Changed

• verify: graph-equivalence gate, no-trace scan, notices, results by @AmanSwar in #1
• GLM-5.3-Flash model layer and kernels by @AmanSwar in #3
• docs: MEGAKERNELS.md by @AmanSwar in #4
• Served-shape load checks; tp2 test on served shapes by @AmanSwar in #5
• tests: served kernels and model composition by @AmanSwar in #6
• The frozen serving configuration: fused prefill kernels, prefix matching by page hashes, the 512 prefill rung by @AmanSwar in #8
• v0 candidate: serving stack + off-path fixes + rank threads by @AmanSwar in #7
• Engine, OpenAI server, compile pipeline and CLI by @AmanSwar in #2
• Public launch: TrnRT, the open LLM inference engine for AWS Trainium by @sanchitmonga22 in #9
• Pre-launch cleanup: no private trace patterns in the repo; verification status by @AmanSwar in #10
• Link the repository as RunanywhereAI/trnrt-glm by @AmanSwar in #11
• ci: CodeQL through GitHub's default setup; drop the CodeQL workflow by @sanchitmonga22 in #13
• Link the repository as RunanywhereAI/trnrt by @sanchitmonga22 in #12
• ci: run on pushes to development and main by @AmanSwar in #15
• contributing: development for every PR, main for releases, AI review and contributor CI by @sanchitmonga22 in #20
• spec: MTP speculative decoding and the AgentX presets by @AmanSwar in #14
• router: a non-streaming client that disconnects aborts its request on the worker by @jimburtoft in #16
• serve: take the sampling defaults from the checkpoint's generation_config.json, as vLLM does by @jimburtoft in #18
• router: walk the prefix trees for a sessionless request in a worker thread, off the event loop by @jimburtoft in #17
• ci: area labels on every PR from the paths it changes, forks included by @sanchitmonga22 in #26
• serve: incremental detokenize for streams, with an end-of-stream self-check; the rank watch alone at 0.25 s by @sanchitmonga22 in #27
• release: merging a promotion into main is the release, with no manual tag by @sanchitmonga22 in #32
• changelog: the first public release is 0.1.0 by @sanchitmonga22 in #33
• release: v0.1.0 by @sanchitmonga22 in #34

New Contributors

• @AmanSwar made their first contribution in #1
• @sanchitmonga22 made their first contribution in #9
• @jimburtoft made their first contribution in #16

Full Changelog: https://github.com/RunanywhereAI/trnrt/commits/v0.1.0