-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing documents on Vespa Cloud #396
Comments
There are likely schema issues with the documents that are failing. You can inspect the results and see the error messages, for ex.:
|
I tried on a more powerful machine.
No failed feed this time. For context,
I tried ingesting data into prod and see the same number of documents in the prod store as well - 735.1k. What else can I do to check what went wrong? |
You need to specify
Maybe you have duplicate id`s? |
That's it! Generated ids were not unique and resulted in documents getting overwritten in the index. Thanks for the pointer. |
Hi!
I noticed that some batches didn't complete successfully during batch feed to Vespa Cloud.
I was ingesting a dataset of about 1M documents, but Vespa Cloud only shows 735k.
Assuming it's because of the failed batches, I reingested the dataset. However, I still saw failures (but not the same batches that failed earlier) and the document count is still stuck at 735k on the dashboard as well as the query response json.
Disk usage is around 2% on Vespa Cloud dashboard.
What should I do? Thanks!
The text was updated successfully, but these errors were encountered: