Repository navigation
Replies: 2 comments 1 reply
|
Short answer: PyPI is the expected home — there is no listing step for an external package anymore. The repo's CONTRIBUTING.md says it directly: "we are no longer accepting new integration packages in this repository. New integrations should be maintained in their own repositories and published to PyPI independently. PRs that add a new What you already have is the right shape: the package on PyPI with the |
|
Hi @wiiiktor — just checking in: did my answer above resolve this for you? If it did, marking it as the answer would help others with the same issue find it. If it didn't, let me know what happened when you tried it and I'll dig further. |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
HEY ALL! -> I built a small open model that cuts out the important pieces from a longer text -> about 2-5%, and throws out the rest (spam, noise).
This works at the quality level of 80-90% of Opus 5.5 doing the same job, but is very small -> 0.3 B params.
pip install "chopper-rag[llama-index]"
from chopper_rag.llama_index import ChopperPostprocessor
query_engine = index.as_query_engine(similarity_top_k=16, node_postprocessors=[ChopperPostprocessor()])
Video: https://claude.ai/artifact/SKT1Zx9ZZ85FExPZ53dV6K
Code: https://github.com/wiiiktor/chopper_demo
Question for the maintainers: what is the right way to get an external package like this listed on LlamaHub / the community integrations page? Happy to split it out as llama-index-postprocessor-chopper if that is preferred. (It has been already accepted by LangChain.)
All reactions