v0.2.10

Highlights

• OpenAI-compatible embeddings API
• OpenAI-compatible Files API
• Postgres support in starter distro
• Enable ingestion of precomputed embeddings
• Full multi-turn support in Responses API
• Fine-grained access control policy

What's Changed

• fix: Fix requirements from broken github-actions[bot] by @franciscojavierarceo in #2323
• feat: Enable ingestion of precomputed embeddings by @franciscojavierarceo in #2317
• fix: Responses streaming tools don't concatenate None and str by @bbrowning in #2326
• feat: New OpenAI compat embeddings API by @hardikjshah in #2314
• refactor: remove container from list of run image types by @Bobbins228 in #2178
• chore: help setuptools finding the project path by @leseb in #2333
• chore: remove usage of load_tiktoken_bpe by @leseb in #2276
• fix: remote-vllm event loop blocking unit test on Mac by @bbrowning in #2332
• feat: openai files api by @ehhuang in #2321
• docs(kubernetes): add more fleshed-out example of a Demo Kubernetes cluster by @ashwinb in #2329
• fix: fireworks provider for openai compat inference endpoint by @hardikjshah in #2335
• revert: "chore: Remove zero-width space characters from OTEL service" by @leseb in #2331
• docs(mcp): add a few lines for how to specify Auth headers in MCP tools by @ashwinb in #2336
• fix: remove openai dep by @ehhuang in #2337
• feat(responses): implement full multi-turn support by @ashwinb in #2295
• chore: revert llama-stack-client dep by @ehhuang in #2342
• fix: ollama chat completion needs unique ids by @bbrowning in #2344
• docs(k8s): add UI template by @ashwinb in #2343
• feat: reference implementation for files API by @ehhuang in #2330
• docs: Add missing dependencies in quickstart demo command by @jgarciao in #2347
• feat: add postgres deps to starter distro by @ashwinb in #2360
• feat(distro): add more providers to starter distro, prefix conflicting models by @ashwinb in #2362
• fix: resolve template name to config path in llama stack run by @Ygnas in #2361
• feat: Structured output for Responses API by @bbrowning in #2324
• feat: fine grained access control policy by @grs in #2264
• chore(ui): use proxy server for backend API calls; simplified k8s deployment by @ehhuang in #2350
• feat(responses): add more streaming response types by @ashwinb in #2375
• docs: Add OpenAI API compatibility page by @bbrowning in #2316
• fix: remove debug print accidentally merged by @grs in #2393
• fix: vllm starter name by @leseb in #2392
• chore: update postgres_demo distro config by @ehhuang in #2396
• docs: update contributing guidance around uv python versions by @nathan-weinberg in #2398
• fix(server): Add missing OpenTelemetry dependencies to resolve telemetry import errors by @jangel97 in #2391
• refactor: unify stream and non-stream impls for responses by @ashwinb in #2388
• ci: run integration test on more python version by @leseb in #2400
• fix: update pyproject to include recursive LS deps by @hardikjshah in #2404
• chore: remove dead code by @ehhuang in #2403
• test: skip files integrations tests for library client by @ehhuang in #2407
• feat: add deps dynamically based on metastore config by @ehhuang in #2405
• fix: Pin fastapi to avoid picking up spurious versions in test pypi by @hardikjshah in #2409

New Contributors

• @jgarciao made their first contribution in #2347
• @jangel97 made their first contribution in #2391

Full Changelog: v0.2.9...v0.2.10