v0.1.8

Release Date: April 2026

This release ships multi-instance management (registry-backed tabs and Management → Instances), improves remote and LiteLLM connectivity and model selection, and fixes benchmarking so auth and model IDs match the server you target.

Install: pip install vllm-playground==0.1.8 — https://pypi.org/project/vllm-playground/

---

Highlights

Multi-Instance Backends

Run and manage several vLLM servers at once — subprocess, container, and remote — each as its own Instance with isolated chat, logs, and metrics.

• Instance registry with persistence under ~/.vllm-playground/instances.json
• Per-instance tabs on the vLLM Server page; switch active instance with one click
• Management → Instances grid: search, status, connect/stop, and saved configurations
• See the Multi-Instance Guide for workflows and tips

Remote Server & LiteLLM

• Resilient remote URLs — normalization for OpenAI-compatible roots and LiteLLM-style bases; connect probing without requiring /health on every deployment
• Chat model list from /v1/models — populate the model dropdown from the active server; better alignment with served-model aliases and remote catalogs
• Context length — improved handling when gateways expose limits via model metadata (e.g. LiteLLM model/info-style data)

Benchmarking (Built-in & GuideLLM)

• Bearer Authorization for OpenAI-compatible remote targets (LiteLLM, etc.)
• Optional API key from the UI for remote benchmarks; keys are not applied to localhost/container targets (avoids breaking local vLLM with gateway tokens)
• Model ID matches the selected instance — when GuideLLM / built-in benchmark sends instance_id, the OpenAI model field (and GuideLLM --model when set) comes from that registry entry (served_model_name, then model, then saved config), fixing typical 404 model not found when the UI session was still on a different remote model

UI & Reliability

• GuideLLM target-instance dropdown stability when the instance list updates
• GPU memory utilization input normalized (e.g. fractional vs percentage)
• Mode switch clears stale remote model selection where appropriate

---

Upgrade

pip install --upgrade vllm-playground

From Source

git clone https://github.com/micytao/vllm-playground.git
cd vllm-playground
pip install -e .
vllm-playground

---

Documentation

• Changelog — Version history
• Multi-Instance Guide — Instances, tabs, and management UI
• Installation Guide — Setup instructions

---

Links

• PyPI: https://pypi.org/project/vllm-playground/
• vLLM Workshop: https://micytao.github.io/vllm-workshop/