Version 2.7.2021-experimental

Windows ML 2.7.2021 Experimental brings two big additions. The new Windows ML Runtime API is a Windows-native inferencing API built for performance, deep OS integration, and precise control when you want it. And GGUF support lets you bring the latest open-source language models from HuggingFace into the same Windows ML stack you already use.

This is an early look: as these APIs mature, we'll expand support to a broader range of workloads and execution engines, add deeper performance optimizations, and broaden silicon coverage. To get started, check out:

Install the release: Windows ML 2.7.2.7.2021 Experimental

• Run a GGUF model: Text Generation API docs
• Transcribe audio: Speech Recognition API docs
• Explore the native runtime: Windows ML Runtime API docs
• See it in action: Runtime API samples

We'd love your feedback on the API shape, the developer experience, and the models and scenarios that matter most to you. Read the full announcement, AI Development on Windows: from PyTorch and llama.cpp to Windows ML, then share your feedback on GitHub to help shape our roadmap.

Microsoft.Windows.AI.MachineLearning/2.7.2021-experimental

Microsoft.Windows.AI.MachineLearning.LibLlama.Core/0.5.0.2022-experimental