You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I've been making attempts to use RAGatouille for document retrievals. I'm currently testing it on a junk of 30k emails. After indexing a few of the documents I would want to use the add_to_index function to add new documents to the index. I'm adding 1000 new documents in a loop using add_to_index but it fails to do so after 21 iterations or after indexing 20000 documents and throws:
TypeError: slice indices must be integers or None or have an __index__ method
I've written all this code in this saved Kaggle notebook. I would request you to check it out.
I've tested this multiple times for different numbers and lengths of chunks and seems to give the same TypeError after indexing a particular amount of document chunks.
The text was updated successfully, but these errors were encountered:
Hey, thank you, this is interesting. CRUD is still in a bit of an odd situation (cc @anirudhdharmarajan @jlscheerer) so this is appreciated. It seems like your notebook isn't public -- I get a 404 when trying to access it.
Hi,
I've been making attempts to use RAGatouille for document retrievals. I'm currently testing it on a junk of 30k emails. After indexing a few of the documents I would want to use the
add_to_index
function to add new documents to the index. I'm adding 1000 new documents in a loop usingadd_to_index
but it fails to do so after 21 iterations or after indexing 20000 documents and throws:I've written all this code in this saved Kaggle notebook. I would request you to check it out.
I've tested this multiple times for different numbers and lengths of chunks and seems to give the same
TypeError
after indexing a particular amount of document chunks.The text was updated successfully, but these errors were encountered: