-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve and simplify operations on external documents ids #3379
Comments
Now that we added soft deletion into milli, this One requirement is a performance test just to make sure it doesn't impact the indexation time when adding or removing documents. |
I'd like to try this |
Hello @yenwel Thanks for your interest in this project 🔥 You are definitely more than welcome to open a PR for this! FYI, we prefer not assigning people to our issues because sometimes people ask to be assigned and never come back, which discourages the volunteer contributors from opening a PR to fix this issue. We are looking forward to reviewing your PR 😊 |
Hi I'm having problem getting started following the contributing guidelines. If I try to do cargo run --release I get the error "error: a bin target must be available for |
Hum weird, I don't have the issue Two possibilities
|
I run this at the root of the project Milli. If I run in the subproject of e.g. cli this works fine. |
Oh sorry, I realized I confused this repo with another one! |
663: Fix CONTRIBUTING.md step to make the project work r=Kerollmops a=curquiza Following this discussion: https://github.com/meilisearch/milli/issues/76#issuecomment-1277459125 Co-authored-by: Clémentine Urquizar - curqui <clementine@meilisearch.com>
Oh snap I should have launched a PR myself to get some hacktoberfest points |
Oh sorry! You are right! I wanted to be quick to avoid other confusion, but I should have asked you if you wanted to do it |
@Kerollmops do you want to completely remove the struct or replace its internal dual structure of soft and hard maps with just one map. Just deleting it's seems not trivial since it also now has a member for the softdeletedids. |
@yenwel I would like to replace it with a single map, please. |
Here's the replacement of soft and hard with a single map: meilisearch/milli#666 tbd: need to figure out benchmarking in https://github.com/meilisearch/milli/tree/main/benchmarks |
Sadly I won't be able to bring meilisearch/milli#666 to end due to obligations - issue is free for taking again, I'm sorry 🙇 |
No problem @msvaljek, thanks for letting us know! For anyone wanting to fix this issue, the meilisearch/milli#666 PR is a good start, you just need to apply Kero's requests of change. Thanks again for your time @msvaljek |
We need to remove the soft and hard external documents ids maps because it is just a lot of code to maintain that is not worth it. That is only interesting on the first additions of a small number of documents.
The text was updated successfully, but these errors were encountered: