A tooling census — what do you actually use to evaluate? #137
akash-coded
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Not what you would recommend. What is actually running in your repository right now.
Why "none" is a fine answer
More than half of production RAG systems have no eval set at all, and the people who say so
honestly are more useful in this thread than the people who describe an aspiration.
If your answer to blocks a merge is no, say what would have to be true for it to become yes.
That is usually the interesting constraint, and it is rarely technical.
All reactions