Skip to content

PyInferenceManager v0.4.2

Latest

Choose a tag to compare

@Mullassery Mullassery released this 29 Jul 21:41
· 52 commits to main since this release

Version 0.4.2: Production release with updated README and version sync

Changes

  • Removed emojis and icons from README for professional presentation
  • Synchronized version across Cargo.toml and README (0.3.1 → 0.4.2)
  • Enhanced documentation with architecture details and platform support

Quality

  • 261 comprehensive unit and integration tests passing
  • Production-optimized multi-provider routing
  • Full OpenTelemetry observability instrumentation

Distribution

  • Wheels-only PyPI release (no source code)
  • Python 3.10+ (abi3 extension module)
  • Precompiled for macOS (Intel and Apple Silicon), Linux, Windows

Capabilities

  • Multi-provider routing (Anthropic, OpenAI, Ollama)
  • Semantic caching with TTL eviction and similarity scoring
  • Cost-aware routing with budget enforcement
  • Automatic failover and intelligent retry logic
  • Real-time stats dashboard with separate terminal spawning
  • Full OpenTelemetry observability

Installation

pip install pyinferencemanager

See https://github.com/Mullassery/PyInferenceManager for full documentation.