Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Report stage task distribution and skewness #15286

Merged
merged 2 commits into from
Dec 16, 2022
Merged

Report stage task distribution and skewness #15286

merged 2 commits into from
Dec 16, 2022

Conversation

sopel39
Copy link
Member

@sopel39 sopel39 commented Dec 2, 2022

No release nodes needed

@cla-bot cla-bot bot added the cla-signed label Dec 2, 2022
@sopel39 sopel39 mentioned this pull request Dec 2, 2022
Closed
@sopel39
Report task input and output distribution in EXPLAIN ANALYZE VERBOSE
4b62dbd 
Example:

 Fragment 2 [SOURCE]
     CPU: 618.74ms, Scheduled: 1.23s, Blocked 2.95s (Input: 0.00ns, Output: 0.00ns), Input: 6001215 rows (51.51MB); per task: avg.: 6001215.00 std.dev.: 0.00, Output: 3 row
     Output buffer active time: 5.66ms, buffer utilization distribution (%): {p01=0.00, p05=0.00, p10=0.00, p25=0.00, p50=0.00, p75=0.00, p90=0.00, p95=0.00, p99=0.00, max=
     Task output distribution: {count=1.00, p01=12.87MB, p05=12.87MB, p10=12.87MB, p25=12.87MB, p50=12.87MB, p75=12.87MB, p90=12.87MB, p95=12.87MB, p99=12.87MB, max=12.87MB
     Task input distribution: {count=1.00, p01=12.87MB, p05=12.87MB, p10=12.87MB, p25=12.87MB, p50=12.87MB, p75=12.87MB, p90=12.87MB, p95=12.87MB, p99=12.87MB, max=12.87MB}
@sopel39
Report if stage might be skewed in EXPLAIN ANALYZE
15f97ab 
Example:

 Fragment 1 [HASH]
     Amount of input data processed by the workers for this stage might be skewed
@sopel39 sopel39 merged commit 1aeb8e4 into trinodb:master Dec 16, 2022
@sopel39 sopel39 mentioned this pull request Dec 16, 2022
Closed
@github-actions github-actions bot added this to the 404 milestone Dec 16, 2022
@sopel39 sopel39 deleted the ks/report_stage_dist branch December 16, 2022 14:28
@colebow colebow mentioned this pull request Dec 21, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@raunaqmorarka raunaqmorarka raunaqmorarka approved these changes

Assignees
No one assigned
Labels
cla-signed
Milestone
405
Development

Successfully merging this pull request may close these issues.
2 participants
@sopel39 @raunaqmorarka