PyStreamAI v0.1: Production-Ready

🚀 First public release

What's Included:

• 40-50x inference speedup (ONNX + TensorRT + quantization + batching)
• Zero YAML configuration - feels like FastAPI
• Multi-cloud deployment (AWS, GCP, Azure, on-prem, edge)
• Automatic GPU optimization (A100, H100, L4, V100, T4)
• Built-in cost tracking and monitoring
• Production-ready observability (OpenTelemetry)

Installation:

pip install pystreamai

Quick Start:
See docs/GETTING_STARTED.md

Features:

• Auto-optimization stacking
• Dynamic batching
• Semantic caching
• LLM optimizations (speculative decoding, prompt caching, paged attention)
• Edge deployment (mobile, IoT, WASM)
• Canary deployments and A/B testing
• Hot-reload (zero-downtime updates)

License: Proprietary (wheels only - source code stays private)