Repository navigation
Release Notes: Intel® AI for Enterprise Agent Toolkit – Version 0.5.0
Tag: release-0.5.0 | License: Apache 2.0
Overview
Intel® AI for Enterprise Agent Toolkit an open source, production-grade, Kubernetes-based platform for deploying and operating enterprise AI agents on Intel® Xeon® processors.
The toolkit bundles all infrastructure components required to move from prototype to production: a policy-driven API gateway, intelligent LLM inference routing and full observability. All pre-integrated and deployable in a single automated workflow.
System Requirements
| Category | Minimum | Recommended |
|---|---|---|
| OS | Ubuntu 22.04, Ubuntu 24.04 | |
| CPU | Intel® Xeon® Scalable (x86_64), 96 cores | 96+ cores |
| RAM | 256 GB | 256+ GB |
| Disk | 150 GB (varies by model) | 200 GB |
| Architecture | x86_64 | x86_64 |
Additional requirements: internet access, SSH key pair, SSL/TLS certificates, Hugging Face API token with read access to gated models.
Deployment Modes
- Single Node Deployment
Key Features
Kubernetes Orchestration
Automates deployment, scaling, and management of AI inference clusters.
Model Management
Automated deployment and lifecycle management of LLM models; supports pre-validated models available on Hugging Face Hub.
Referred models will be automatically downloaded from Hugging Face.
Observability
Native Kubernetes monitoring (metrics, visualization, alerting) for apps and cluster health.
Automation Scripts
End-to-end scripts for cluster setup, deployment, and model onboarding.
Memory
(Redis + RediSearch (short-term) · PostgreSQL + pgvector (long-term)
Full-lifecycle agent memory: short-term session context and long-term cross-session knowledge. Enables RAG, semantic search, and stateful multi-turn workflows.
Intelligent Routing
Routes LLM workloads to the optimal compute target by task intent — reasoning tasks to to GPU or cloud/MaaS endpoints; execution, encoding, and coordination tasks are routed to CPU on Xeon. Configurable per application, model-agnostic.
Updated Model Support
The following models are available for CPU deployment via the interactive model selection menu:
| # | Model | Type |
|---|---|---|
| 21 | meta-llama/Llama-3.1-8B-Instruct |
LLM (General purpose)) |
| 22 | Qwen/Qwen3-Coder-30B-A3B-Instruct |
LLM (Coding) |
| 23 | Qwen/Qwen2.5-Coder-14B-Instruct |
LLM (Coding) |
| 24 | openai/whisper-small |
LLM (Coding) |
| 23 | BAAI/bge-small-en-v1.5 |
Embedding |
| 23 | BAAI/bge-reranker-base |
Reranker |
vLLM Version
vLLM CPU image version v0.21.0.
Proxy Support
Corporate HTTP/HTTPS proxy support for fresh installs . All Ansible playbooks (cluster.yml) propagate proxy_env to package installs, kubeadm join, image pulls, and containerd systemd drop-in configuration.
Component Versions
| Component | Version |
|---|---|
| vLLM CPU Image | v0.21.0 |
| Observability Stack Chart | 72.5.1 |
| Langfuse Trace Chart | 1.5.30 |
| Ingress Controller | 4.12.2 |
Resources
License
- Licensed under the Apache License 2.0.
Thank you for using Intel® AI for Enterprise Agent Toolkit!