Repository navigation
Releases: ShreyamMaity/modelgate
Releases · ShreyamMaity/modelgate
Release list
v0.3.0
What's Changed
- Improved model configuration
Highlights
- Per-group routing policy:
sticky,strictorfailover, with sticky scope (conversation, day or until changed), TTL, failover trigger (errors only or errors and timeouts), retries on the same model, first-token and total timeouts, and cooldown - Sticky routing keeps a conversation on one model and only moves on a real failure, so answers stay consistent
- Optional pin to an exact model per request
- Responses report the model that answered, whether it was pinned, and any failover with its reason (headers and stream events)
- Test traffic keeps its own cooldowns, so test runs never affect real traffic
/configpage and API: edit policies, create and delete groups, list groups, view and clear pins- Longer default timeouts with stream keepalives for long tool-heavy answers
Full Changelog: v0.2.0...v0.3.0
What's Changed
- PII improvements by @ShreyamMaity in #5
- PII improvements by @ShreyamMaity in #6
- PII improvements by @ShreyamMaity in #7
Full Changelog: v0.2.0...v0.3.0
What's Changed
- PII improvements by @ShreyamMaity in #5
- PII improvements by @ShreyamMaity in #6
- PII improvements by @ShreyamMaity in #7
Full Changelog: v0.2.0...v0.3.0
What's Changed
- PII improvements by @ShreyamMaity in #5
- PII improvements by @ShreyamMaity in #6
- PII improvements by @ShreyamMaity in #7
Full Changelog: v0.2.0...v0.3.0
What's Changed
- PII improvements by @ShreyamMaity in #5
- PII improvements by @ShreyamMaity in #6
- PII improvements by @ShreyamMaity in #7
Full Changelog: v0.2.0...v0.3.0
V0.2
What's Changed
- Add embedding and other model support
- PII layer
- Presence routing
- PII improvements
Full Changelog: v0.1.0...v0.2.0
What's Changed
- Add embedding and other model support by @ShreyamMaity in #1
- PII layer by @ShreyamMaity in #2
- Presence routing by @ShreyamMaity in #3
- PII improvements by @ShreyamMaity in #4
New Contributors
- @ShreyamMaity made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0
What's Changed
- Add embedding and other model support by @ShreyamMaity in #1
- PII layer by @ShreyamMaity in #2
- Presence routing by @ShreyamMaity in #3
- PII improvements by @ShreyamMaity in #4
New Contributors
- @ShreyamMaity made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0
What's Changed
- Add embedding and other model support by @ShreyamMaity in #1
- PII layer by @ShreyamMaity in #2
- Presence routing by @ShreyamMaity in #3
- PII improvements by @ShreyamMaity in #4
New Contributors
- @ShreyamMaity made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0
What's Changed
- Add embedding and other model support by @ShreyamMaity in #1
- PII layer by @ShreyamMaity in #2
- Presence routing by @ShreyamMaity in #3
- PII improvements by @ShreyamMaity in #4
New Contributors
- @ShreyamMaity made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0
v0.1.0
Full Changelog: https://github.com/ShreyamMaity/modelgate/commits/v0.1.0
Full Changelog: https://github.com/ShreyamMaity/modelgate/commits/v0.1.0
Full Changelog: https://github.com/ShreyamMaity/modelgate/commits/v0.1.0
Full Changelog: https://github.com/ShreyamMaity/modelgate/commits/v0.1.0