Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exposed to ES mapping explosion #266

Open
bkis opened this issue Jun 24, 2024 · 1 comment
Open

Exposed to ES mapping explosion #266

bkis opened this issue Jun 24, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@bkis
Copy link
Member

bkis commented Jun 24, 2024

The way we index annotations might open the app up to a potential mapping explosion.

We should evaluate mapping annotations as [{"k": "...", "v": "..."}, ...] instead of {k: v, ...} – especially building queries might become tricky.

@bkis bkis added the bug Something isn't working label Jun 24, 2024
@bkis bkis self-assigned this Jun 24, 2024
@bkis
Copy link
Member Author

bkis commented Jul 3, 2024

These seem to be the possible ways to go about this, from most to least horrifying in terms of dev effort:

  1. Use multiple indexes (no! getting results ranking to work will be a hacky nightmare!)
  2. Find another way to index the annotation data (needs some research and evaluation, might be a lot of work, unlikely to work without losing some features such as query string queries on annotation values, would be the cleanest solution if there is a way at all)
  3. Just live with this limitation, document it, make the admin UI warn the admins if this limit is reached (can the ES API tell us?) and maybe even make the indexing of non-published resources configurable on dev-ops level with a default of false
  4. Delete the repo and look for a different carreer

Currently, solution 3 looks like the most attractive one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant