Skip to content

Log the number of bytes returned from historical when max scatter-gather is reached #18840

@TessaIO

Description

@TessaIO

Description

Currently, when the query returned data is bigger than the max scatter-gather, we just log that the query's max scatter-gather bytes limit is reached, but we don't have visibility on how big is the data returned from the historical which makes Druid administration hard.

Motivation

We have some queries that are different in their nature and a max scatter-gather value can fit one query but not all. We want to this value on the context of the query so it's pretty customized. And for that, we need to know how much each query needed when it fails so we can adjust this value.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions