Repository navigation
Jev usage for model routing / auto-approvals #5323
jayjay181818
started this conversation in
Ideas
Replies: 1 comment
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I've seen a fair few projects for other harnesses utilising Jev for model routing; this could prove very beneficial for maximising output quality as well as reducing spend costs - which I know we are all struggling with as of late.
How I believe it could be handled, potentially, would be a custom slider for cost vs quality, as we could rank weights for cost and quality in different areas.
Another thought is whether it's feasible to trim even more quota usage via Jev for auto-approvals.
I wondered what people's opinions are on utilising Jev within OpenCodex?
This has to be one of my favourite projects of the year, keep up the amazing work!!!
All reactions