Repository navigation
Version 0.4.2: Production release with updated README and version sync
Changes
- Removed emojis and icons from README for professional presentation
- Synchronized version across Cargo.toml and README (0.3.1 → 0.4.2)
- Enhanced documentation with architecture details and platform support
Quality
- 261 comprehensive unit and integration tests passing
- Production-optimized multi-provider routing
- Full OpenTelemetry observability instrumentation
Distribution
- Wheels-only PyPI release (no source code)
- Python 3.10+ (abi3 extension module)
- Precompiled for macOS (Intel and Apple Silicon), Linux, Windows
Capabilities
- Multi-provider routing (Anthropic, OpenAI, Ollama)
- Semantic caching with TTL eviction and similarity scoring
- Cost-aware routing with budget enforcement
- Automatic failover and intelligent retry logic
- Real-time stats dashboard with separate terminal spawning
- Full OpenTelemetry observability
Installation
pip install pyinferencemanagerSee https://github.com/Mullassery/PyInferenceManager for full documentation.