New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce amount of data returned by ES #32

Open

rimutaka opened this issue Mar 4, 2022 · 1 comment

Member

rimutaka commented Mar 4, 2022

Dev and Org profiles can get really big. Returning the entire _source as JSON makes no sense for lists when only a few properties are being used.

Exclude some of the fields with

GET /org/_search?_source_excludes=report.file_types,report.reports_included,report.projects_included,report.commit_time_histo, report.contributor_git_ids

Refs and packages may be needed if there was a search for them.

The text was updated successfully, but these errors were encountered:

Member Author

rimutaka commented Mar 10, 2022

This was a dumb idea. The performance of this feature is even worse than dealing with the full document. See https://discuss.elastic.co/t/source-excludes-includes-makes-query-2-times-slower/222227/2 for details.

The best way to solve this is to have a separate index with minimal amount of info + the current index for more detailed queries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment