Skip to content

v0.2.1

Latest

Choose a tag to compare

@merceod merceod released this 16 Sep 09:34
· 582 commits to main since this release
b333630

First release on PyPI. Install with pip install mstar-ai (mstar-project and mstar-serve are alias packages that install the same thing). The import package and the CLI are still mstar.

What's Changed

  • communication: vendored Rust transport (rust/) + RustZMQCommunicator (RFC #130 Step 1) by @npuichigo in #164
  • [Fix] Conductor SIGINT, piecewise KV capture, and batched AC rollout split by @merceod in #176
  • Register for send signature change by @stephen-dwq in #177
  • Add ASR model support: whisper-large-v3 and higgs-audio-v3-stt by @zhudianGG in #159
  • Pin worker executor threads to the worker's CUDA device by @merceod in #180
  • Drain API result reads ahead of preprocess and fail requests on deliv… by @merceod in #181
  • streaming: guarantee a terminal StreamBuffer chunk after producer-done by @stephen-dwq in #179
  • Worker Bug Fixes by @NSagan271 in #183
  • pin ruff + ignore Too many positional arguments by @NSagan271 in #187
  • fix(client): decode streamed lines when Content-Type has no charset by @Sanjays2402 in #190
  • Fix KeyError in eager batched execution for packed-output submodules by @NSagan271 in #195
  • SHM tensor transport over a Rust shared-memory arena (RFC #130, Step 2) by @npuichigo in #168
  • Qwen3-Omni Audio Understanding Bug Fixes by @NSagan271 in #196
  • Cosmos3 droid by @merceod in #188
  • Pluggable routers by @stephen-dwq in #189
  • Add Qwen3-TTS-12Hz-0.6B-CustomVoice support by @qaqjx in #184
  • Fail requests on worker error by @NSagan271 in #200
  • Add Wan2.2: text/image-to-video (issue #126) by @Gaurav-Shah05 in #165
  • Allow Multiple Sampling Configs Per Node by @NSagan271 in #201
  • local reduce before all-reduce in tp moe blocks by @stephen-dwq in #206
  • Perf(qwen3-tts): fuse CodePredictor RoPE and reuse decode masks by @qaqjx in #204
  • Rust HTTP frontend behind --rust-frontend (RFC #130, Step 3) by @npuichigo in #169
  • tests: modular: fix WorkerGraphsManager API drift by @vishwanath1306 in #229
  • Dynamo backend by @merceod in #216
  • [1/3] Extend device support from CUDA-only by using torch.accelerator in worker runtime by @yao-matrix in #219
  • Refactor of Resources -> Resource Pools by @NSagan271 in #228
  • api: pass raw request through image edits by @kamahori in #227
  • test: update stale orpheus modular test to the decode_finished contract by @vasilevklart in #205
  • fix(position): respect device-specific autocast state by @ryux1 in #240
  • feat(#209): Order-preserving multimodal input adapter by @t-avil in #226
  • api: accept unpadded base64 in input_audio.data by @appleweiping in #235
  • Pypi packaging by @merceod in #242
  • Ragged prefill wrapper by @NSagan271 in #236
  • api: return 400 for malformed model kwargs by @appleweiping in #245
  • sampling: write master rows with a scalar fill_, not through a reused pinned row by @vasilevklart in #222
  • worker: async scheduling for TP nodes (MSTAR_TP_ASYNC_SCHED) by @vasilevklart in #224
  • docs: resolve version from the m-star distribution by @Gaurav-Shah05 in #248
  • Extend Double-Buffering to the Piecewise Cuda Graph Runner by @NSagan271 in #243
  • Fix Broken Tests by @NSagan271 in #246
  • Register tensor memory with mooncake under TCP, not just RDMA by @Gaurav-Shah05 in #252
  • Feature/tp support crossattention by @Raphistolage in #250
  • [2/N] Add BAGEL tensor-parallel serving on Intel GPU(XPU) by @yao-matrix in #220
  • Bug fix: gate tensor transport teardown behind a reader-drain barrier (fixes abort-time FileNotFoundError) by @NSagan271 in #234
  • Publish the engine as mstar-ai instead of m-star by @merceod in #259
  • Release 0.2.1 and publish the aliases from the workflow by @merceod in #260

New Contributors

Full Changelog: v0.2.0...v0.2.1