v3.1.0.rc1

What's new in 3.1.0.rc1 (2026-07-29)

These are the changes in inference v3.1.0.rc1.

New features

• feat(ui): add SSO/OIDC login button to login page by @m199369309 in #5218
• feat: launch model worker multi select by @maoyuehui in #5222
• feat(audio): batch Qwen3-ASR transcriptions by @qinxuye in #5172
• feat(webui): add auto-refresh to audit center by @m199369309 in #5226
• feat(webui): show API key name and model ID columns in audit center by @m199369309 in #5229
• feat(webui): multi-dashboard monitor center with admin config dialog by @m199369309 in #5225
• feat(frontend): auto-reload shell routes on export directory change by @m199369309 in #5243
• feat(vllm): populate logprobs/top_logprobs in completion responses by @SuperMarioYL in #5245
• feat(webui): support multi-node selection in log center by @m199369309 in #5246
• feat: speculative decoding with paired drafter checkpoints by @qinxuye in #5241
• feat(engine): [image, audio] sglang image vllm asr engines by @OliverBryant in #5121
• feat(webui): add missing permission scopes (models:register, logs:list, monitor:view) to UI by @m199369309 in #5254

Enhancements

• ENH: update models JSON [embedding, rerank] by @XprobeBot in #5214
• ENH: update models JSON [audio] by @XprobeBot in #5233
• ENH: update models JSON [llm] by @XprobeBot in #5236
• ENH: display replica launch status in responsive grid by @leslie2046 in #5239
• ENH: update models JSON [audio, embedding, image, llm, rerank] by @XprobeBot in #5251
• BLD: build the aarch64 image from the unified slim Dockerfile by @OliverBryant in #5209
• BLD: improve Docker build caching by @leslie2046 in #5231

Bug fixes

• fix(embedding/rerank): fix sentence_transformers load failures from torch-ecosystem package mismatches by @OliverBryant in #5210
• fix(webui): show model engine on running-model detail page by @OliverBryant in #5211
• fix(pypiserver): emit model source paths with forward slashes by @OliverBryant in #5216
• fix: (UI) Update the label of n_gpu except for LLM and Image types by @maoyuehui in #5217
• FIX: mitigate Slow HTTP DoS (Slowloris) by enforcing a request receipt deadline by @OliverBryant in #5213
• fix(api): cast replica to int to prevent TypeError on multi-replica launch by @m199369309 in #5220
• fix(venv): pin torch to system version to prevent torchvision ABI crash on relaunch by @OliverBryant in #5212
• BUG: worker keeps stale model state after a launch fails during async engine load by @OliverBryant in #5193
• fix(audio/indextts2): declare the missing IndexTTS2 virtualenv dependencies (#5201) by @OliverBryant in #5223
• fix(vllm): add #system_numpy# and pin vllm to 0.21.0 for Ornith/qwen3.5/qwen3.6 by @m199369309 in #5235
• fix(mlx): keep VLM generation on a dedicated thread by @qinxuye in #5234
• fix: disambiguate replica model UIDs with -rep{n} suffix by @Solaris-star in #5215
• fix: allow virtualenv packages to override system markers by @LauraGPT in #5204
• fix(embedding): re-normalize per-item index after batch split by @m199369309 in #5240
• FIX: suppress GPU warnings in CPU image by @leslie2046 in #5238
• fix(i18n): change SSO button text from Keycloak to generic SSO by @m199369309 in #5244
• bug: cover list_models tolerance for stale replica uids by @OliverBryant in #5168
• fix: stabilize Jina v5 and Qwen3 reranker deployment by @OliverBryant in #5232
• FIX: worker reconnection after supervisor restart by @leslie2046 in #5250
• fix(webui): improve worker node display in multi-select by @m199369309 in #5255
• fix(worker): skip redundant virtualenv setup when replicas share the same venv by @m199369309 in #5256

Documentation

• doc: fix v3.0.0 Chinese release links by @qinxuye in #5205

Others

• ci: use merge-base diff for PR GPU tests by @qinxuye in #5224
• docs: update release notes links from xinference.io to xinference.co by @martinma51 in #5248
• Consolidate packaging configuration into pyproject.toml by @OliverBryant in #5249

New Contributors

• @Solaris-star made their first contribution in #5215
• @LauraGPT made their first contribution in #5204
• @SuperMarioYL made their first contribution in #5245
• @martinma51 made their first contribution in #5248

Full Changelog: v3.0.0...v3.1.0.rc1