Repository navigation
First release on PyPI. Install with pip install mstar-ai (mstar-project and mstar-serve are alias packages that install the same thing). The import package and the CLI are still mstar.
What's Changed
- communication: vendored Rust transport (rust/) + RustZMQCommunicator (RFC #130 Step 1) by @npuichigo in #164
- [Fix] Conductor SIGINT, piecewise KV capture, and batched AC rollout split by @merceod in #176
- Register for send signature change by @stephen-dwq in #177
- Add ASR model support: whisper-large-v3 and higgs-audio-v3-stt by @zhudianGG in #159
- Pin worker executor threads to the worker's CUDA device by @merceod in #180
- Drain API result reads ahead of preprocess and fail requests on deliv… by @merceod in #181
- streaming: guarantee a terminal StreamBuffer chunk after producer-done by @stephen-dwq in #179
- Worker Bug Fixes by @NSagan271 in #183
- pin ruff + ignore Too many positional arguments by @NSagan271 in #187
- fix(client): decode streamed lines when Content-Type has no charset by @Sanjays2402 in #190
- Fix KeyError in eager batched execution for packed-output submodules by @NSagan271 in #195
- SHM tensor transport over a Rust shared-memory arena (RFC #130, Step 2) by @npuichigo in #168
- Qwen3-Omni Audio Understanding Bug Fixes by @NSagan271 in #196
- Cosmos3 droid by @merceod in #188
- Pluggable routers by @stephen-dwq in #189
- Add Qwen3-TTS-12Hz-0.6B-CustomVoice support by @qaqjx in #184
- Fail requests on worker error by @NSagan271 in #200
- Add Wan2.2: text/image-to-video (issue #126) by @Gaurav-Shah05 in #165
- Allow Multiple Sampling Configs Per Node by @NSagan271 in #201
- local reduce before all-reduce in tp moe blocks by @stephen-dwq in #206
- Perf(qwen3-tts): fuse CodePredictor RoPE and reuse decode masks by @qaqjx in #204
- Rust HTTP frontend behind --rust-frontend (RFC #130, Step 3) by @npuichigo in #169
- tests: modular: fix WorkerGraphsManager API drift by @vishwanath1306 in #229
- Dynamo backend by @merceod in #216
- [1/3] Extend device support from CUDA-only by using torch.accelerator in worker runtime by @yao-matrix in #219
- Refactor of Resources -> Resource Pools by @NSagan271 in #228
- api: pass raw request through image edits by @kamahori in #227
- test: update stale orpheus modular test to the decode_finished contract by @vasilevklart in #205
- fix(position): respect device-specific autocast state by @ryux1 in #240
- feat(#209): Order-preserving multimodal input adapter by @t-avil in #226
- api: accept unpadded base64 in input_audio.data by @appleweiping in #235
- Pypi packaging by @merceod in #242
- Ragged prefill wrapper by @NSagan271 in #236
- api: return 400 for malformed model kwargs by @appleweiping in #245
- sampling: write master rows with a scalar fill_, not through a reused pinned row by @vasilevklart in #222
- worker: async scheduling for TP nodes (MSTAR_TP_ASYNC_SCHED) by @vasilevklart in #224
- docs: resolve version from the m-star distribution by @Gaurav-Shah05 in #248
- Extend Double-Buffering to the Piecewise Cuda Graph Runner by @NSagan271 in #243
- Fix Broken Tests by @NSagan271 in #246
- Register tensor memory with mooncake under TCP, not just RDMA by @Gaurav-Shah05 in #252
- Feature/tp support crossattention by @Raphistolage in #250
- [2/N] Add BAGEL tensor-parallel serving on Intel GPU(XPU) by @yao-matrix in #220
- Bug fix: gate tensor transport teardown behind a reader-drain barrier (fixes abort-time FileNotFoundError) by @NSagan271 in #234
- Publish the engine as mstar-ai instead of m-star by @merceod in #259
- Release 0.2.1 and publish the aliases from the workflow by @merceod in #260
New Contributors
- @Sanjays2402 made their first contribution in #190
- @qaqjx made their first contribution in #184
- @Gaurav-Shah05 made their first contribution in #165
- @vishwanath1306 made their first contribution in #229
- @yao-matrix made their first contribution in #219
- @vasilevklart made their first contribution in #205
- @ryux1 made their first contribution in #240
- @t-avil made their first contribution in #226
- @appleweiping made their first contribution in #235
- @Raphistolage made their first contribution in #250
Full Changelog: v0.2.0...v0.2.1