🚀 Foundry Local v2.1.0
We're excited to announce Foundry Local v2.1.0. This release makes it easier to bring your own models to local applications, expands tool calling for agentic workflows, and delivers important security, reliability, and inference improvements across the SDKs.
🆕 What's New
📦 Bring Your Own Model
Bring your own ONNX Runtime GenAI models into Foundry Local without copying, downloading, or transferring ownership of the model files.
- Register and unregister models through the local catalog.
- Supply model identity, task, and other metadata through typed builders.
- Use registered models with the same discovery, loading, and session APIs as catalog models.
- Access BYOM from C++, C#, Python, JavaScript/TypeScript, and Rust.
🛠️ More Capable Tool Calling
Tool-enabled chat and agent workflows are more flexible and resilient in v2.1.0.
- Define text-based custom tools for Chat Completions, the Responses API, native sessions, and the stable C ABI.
- Support raw text payloads for tools such as patch application and code-editing operations.
- Improve automatic Qwen tool calling for coding workflows, including enum-valued arguments.
- Recover malformed tool calls more reliably and preserve tool-call boundaries across multi-turn conversations.
🔒 Security, Reliability, and Bug Fixes
- Update dependency groups and core inference components, including ONNX Runtime GenAI 0.17.1.
- Cancel server-sent event inference when clients disconnect and report cancellation consistently.
- Restore model-download cancellation behavior and improve streaming callback handling.
- Fix usage accounting, output-limit reporting, audio language forwarding, and sampling semantics.
- Improve keyboard and screen-reader accessibility throughout the model browser.
📥 Source Code
GitHub automatically includes source archives with the v2.1.0 release:
📚 Resources
| 📖 Documentation | https://aka.ms/foundry-local-docs |
| 🐙 GitHub | https://github.com/microsoft/Foundry-Local |
| 🧪 Samples | https://github.com/microsoft/Foundry-Local/tree/main/samples |
| 💬 Discord | https://aka.ms/foundry-local-discord |
💙 Feedback
File issues at https://github.com/microsoft/Foundry-Local/issues and include the SDK version, platform, and relevant diagnostics.