Repository navigation
Chopper: a small open model that cuts only the needed sentences out of retrieved text #2661
wiiiktor
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hi! Sharing a small open-source tool that may be useful here.
https://github.com/wiiiktor/chopper_demo
A retriever brings back 20 text snippets, but usually only one or two sentences in them answer the question. The chopper is a small model (0.3B parameters, runs locally) that cuts out only those sentences, word for word ("chops"). Nothing is rewritten, so every chop can be traced back to its source. If the answer is not there at all, it says so, so you can search again.
Test made with Qwen3-14B answering 400 questions, one retrieval each:
pip install chopper-ragworks with LangChain, LlamaIndex, Haystack or plain Python. Models (MIT): https://huggingface.co/wiiiktor/chopper_mmbertFeedback is very welcome, especially where it fails.
All reactions