Does this include token reduction and price routing? #287
Unanswered
TomLucidor
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Coming from the other cmux-like tools, I wonder if things like these can have ways to make SLMs more powerful by using performence-aware routers. And if some tasks are hard, maybe context pruning and caveman/ponytail output prompts can come pre-wrapped
All reactions