Discussions

• 1 You must be logged in to vote

  ❓

  Error when reindexing with the same tokenizer

  polakowo asked Jun 4, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  ❓

  How to use tiktoken as a tokenizer?

  AlanLu0808 asked May 20, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Addition of new document in corpus

  souravmpi asked Apr 22, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Install failing on a GPU node

  kaliaanup asked Mar 13, 2025 in Q&A · Unanswered

  

  

  1
• 8 You must be logged in to vote

  📣

  Thank you for 1 million downloads on PyPi 🎉

  xhluca announced Jan 16, 2025 in Announcements

  

  

  

  

  10
• 1 You must be logged in to vote

  ❓

  Get scores for specific documents in index

  kswhitecross asked Mar 4, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  ❓

  passing doc_ids to the retreiver gives me wrong entries

  aflip asked Feb 3, 2025 in Q&A · Closed · Answered

  

  

  3
• 1 You must be logged in to vote

  🌟

  BM25S for japanese

  xhluca started Jan 22, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  ❓

  How to get document's sparse vector ?

  Zrealshadow asked Jan 21, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  how to build index incremently

  bb2103 asked Jan 9, 2025 in Q&A · Closed · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🌟

  I've made an application to search within a collection of PDFs using BM25 and other methods

  Topping1 started Jan 9, 2025 in Show and tell

  

  

  1
• 2 You must be logged in to vote

  📣

  0.2.7pre1

  xhluca announced Dec 29, 2024 in Announcements

  

  

  1
• 1 You must be logged in to vote

  ❓

  stopwords does't work

  wukonggeo asked Dec 25, 2024 in Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  ❓

  Indexing a large .jsonl that cannot be loaded in RAM

  liyucheng09 asked Jul 11, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  ❓

  Can we retrieve the matching tokens for a document?

  mrisher asked Nov 26, 2024 in Q&A · Unanswered

  

  

  4
• 2 You must be logged in to vote

  ❓

  Does langchain Documents work in BM25S?

  pradhandebasish2046 asked Jul 4, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  ❓

  How can you disable tqdm?

  fortyfourforty asked Nov 19, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Is it possible to retrieve only from a subset of the corpus?

  tsdev asked Nov 12, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  search from a subset of indexed documents

  roynirmal started Nov 1, 2024 in General · Closed

  

  

  2
• 1 You must be logged in to vote

  ❓

  How can I use NLTK stemmer with this library

  aflip asked Oct 29, 2024 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  ❓

  Is it possible to incrementally add corpus to a retriever?

  ANYMS-A asked Oct 28, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Can we perform pseudo-relevance feedback with BM25S?

  roynirmal asked Oct 22, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  What does the score output by retrieve mean？

  Ask-sola asked Oct 8, 2024 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  ❓

  Can we retrieve transformed vectors from tokens (or words) as sparse embeddings?

  lspataroG asked Oct 18, 2024 in Q&A · Answered

  

  

  5
• 1 You must be logged in to vote

  ❓

  comparison with vector database that supports sparse vector like milvus

  haowu2651 asked Oct 14, 2024 in Q&A · Answered

  

  

  1