Skip to content

v0.1.1 - Performance & Features Update

Choose a tag to compare

View all tags
@mmdsnb mmdsnb released this 26 Dec 07:47
· 22 commits to master since this release
v0.1.1
c0f6098

FreeRouter v0.1.1 - Performance & Features Update

🚀 New Features

Parallel Provider Fetching ⚡

  • 5x performance improvement for freerouter fetch command
  • Concurrent fetching from multiple providers using ThreadPoolExecutor
  • Typical speedup: 2.5s → 0.5s with 5 providers
  • Robust error handling: one provider failure doesn't block others

Interactive Model Selector 🎯

  • New freerouter select command for choosing specific models
  • Multi-select interface using questionary library
  • Reduces LiteLLM startup time and memory usage
  • Automatic config backup before changes

Enhanced Service Management 🛠️

  • freerouter status - Detailed service status with uptime
  • freerouter reload - Restart service with optional config refresh
  • freerouter restore - Restore configuration from backup
  • Improved logging and error messages

📈 Performance Improvements

  • Parallel Fetching: 3-5x faster model discovery
  • Thread-Safe: Concurrent execution with proper error isolation
  • Scalable: Performance doesn't degrade with more providers

🧪 Testing & Quality

  • 97 tests passing (up from 74)
  • 83% code coverage (up from 79%)
  • New benchmark script: tests/benchmark_parallel_fetch.py
  • Comprehensive parallel execution tests

📚 Documentation

  • New docs/PERFORMANCE.md - Performance optimization details
  • New docs/features/parallel-fetching.md - Feature documentation
  • Updated docs/ROADMAP.md - Feature tracking
  • Enhanced CHANGELOG.md - Detailed version history

🐛 Bug Fixes

  • All providers now disabled by default in freerouter init
  • Fixed CONFIG_FILE_PATH environment variable conflict
  • Improved error messages with context

📦 Installation

pip install --upgrade freerouter

🔧 Usage Examples

Parallel Fetching (Automatic)

freerouter fetch  # Now 5x faster!

Interactive Model Selection

freerouter select  # Choose specific models

Service Management

freerouter status   # Check service status
freerouter reload   # Restart service
freerouter reload -r  # Refresh config and restart

📊 Benchmark Results

Setup:
  Providers: 5
  Delay per provider: 0.5s

Results:
  Sequential time: 2.50s
  Parallel time: 0.50s
  Speedup: 4.99x ✓

🙏 Contributors

Thanks to all contributors who made this release possible!

📝 Full Changelog

See CHANGELOG.md for complete details.

What's Next? Check out our ROADMAP.md for upcoming features!

Assets 2
Loading