Panic using hybrid search

[sam-ulrich1]

I've confirmed that there is a valid embedding being sent and a valid query

2024-04-18T22:38:19.654577Z ERROR meilisearch: info=panicked at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/arroy-0.2.0/src/reader.rs:250:83: called `Option::unwrap()` on a `None` value
2024-04-18T22:38:19.654906Z ERROR HTTP request{method=POST host="meili-meilisearch.gigo-core.svc.cluster.local:7700" route=/indexes/bytes/search query_parameters= user_agent=Meilisearch Go (v0.26.2) status_code=500 error=task 595 panicked}: tracing_actix_web::middleware: Error encountered while processing the incoming HTTP request: ResponseError { code: 500, message: "task 595 panicked", error_code: "internal", error_type: "internal", error_link: "https://docs.meilisearch.com/errors#internal" }
2024-04-18T22:38:19.655012294Z 2024-04-18T22:38:19.654962Z  INFO HTTP request{method=POST host="meili-meilisearch.gigo-core.svc.cluster.local:7700" route=/indexes/bytes/search query_parameters= user_agent=Meilisearch Go (v0.26.2) status_code=500 error=task 595 panicked}: meilisearch: close time.busy=669µs time.idle=7.79ms
2024-04-18T22:38:19.658533Z ERROR meilisearch: info=panicked at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/arroy-0.2.0/src/reader.rs:250:83: called `Option::unwrap()` on a `None` value
2024-04-18T22:38:19.658727629Z 2024-04-18T22:38:19.658687Z ERROR HTTP request{method=POST host="meili-meilisearch.gigo-core.svc.cluster.local:7700" route=/indexes/bytes/search query_parameters= user_agent=Meilisearch Go (v0.26.2) status_code=500 error=task 597 panicked}: tracing_actix_web::middleware: Error encountered while processing the incoming HTTP request: ResponseError { code: 500, message: "task 597 panicked", error_code: "internal", error_type: "internal", error_link: "https://docs.meilisearch.com/errors#internal" }

[sam-ulrich1]

I dropped the whole index and re-created it and now it doesn't happens so it looks like some form of data corruption issue

[sam-ulrich1]

@Kerollmops I guess you're confused? Not sure how to take an emoji

[Kerollmops]

I am just reacting to the issue. Yes, there is a panic in the engine, it seems related to Arroy and we will fix it soon.

[irevoire]

Hey @sam-ulrich1, sorry I’m a little late to the party, but I was wondering, do you have any snapshots or dumps of the data that corrupted your database?

Also, which version of meilisearch were you using, and did you do any updates while you had vectors in your DB?

[sam-ulrich1]

I do not have any dumps for this point in time. I can describe the procedure that led to it. Pretty simple.

• New Index
• Ingest ~1000 new vectors @ 1024 dim
• Perform about 30 searches on it

I'm sure something else contributed though because I dropped the index and recreated with the same steps and it did not corrupt again

[irevoire]

Thanks a lot for the answer!
Two last questions:

• Which version of meilisearch were you using?
• Did you send the 1000 vectors in one document addition or in multiple additions (and if it’s in multiple additions, do you have an idea of the number of vectors per document addition?)