Skip to content

v0.2.0 - Multi-Model Routing

Latest
Latest

Choose a tag to compare

View all tags
@jaybhuvaa jaybhuvaa released this 14 Dec 06:43
· 7 commits to main since this release
v0.2.0
3c2098d

🚀 What's New in v0.2.0

Multi-Model Routing

  • Smart routing now uses different models based on query complexity
  • Simple queries → TinyLlama (fast, <10s)
  • Complex queries → Llama 3.2 (better quality)

Improved Classifier

  • Added system design keywords detection
  • Better scoring for technical queries
  • Adjusted thresholds for more accurate routing

Better Error Handling

  • Detailed timeout messages
  • Improved Ollama integration
  • Configurable timeouts for slow machines
Assets 2
Loading