Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 839: Trigger DPsResolver deferreds in chunks #2200

Closed

Conversation

bshakur8
Copy link

fix #839

In clusters containing tags with high cardinality a query over multiple tags can easily overflow the maximum size of the callback chain resulting in a CallbackOverflowError when creating the callback chain for writing the resulting json output. This change writes the deferrds in chunks to avoid the overflow error.

HariSekhon and others added 13 commits February 24, 2021 16:44
* added tsdb_list_running_queries.py

* updated error handling

* updated tsdb_list_running_queries.py

* various cleanup, removal of old code etc

* switched to custom ConnectionException

* added comment for now_length

Co-authored-by: Hari Sekhon <Hari.Sekhon@gresearch.co.uk>
…r the

Gnuplot params and introducting the tsd.gnuplot.options.allowlist
setting that is a strict matching allow list of o= values from the
query string that will be allowed through. By default tihs is empty
so if folks are using this query param, they'll different graphs
until they add the options they need.
Ensure the scanner callback waits for all the UIDs to resolve before calling scan to retrieve the next set of results.

Not waiting would cause the scanner to close prematurely and return incomplete results.
@bshakur8 bshakur8 marked this pull request as ready for review October 25, 2021 15:29
@bshakur8 bshakur8 changed the title Issue 839: Trigger deferreds in chunks Issue 839: Trigger DPsResolver deferreds in chunks Oct 25, 2021
@bshakur8 bshakur8 closed this Nov 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants