Skip to content

Conversation

@alamb
Copy link
Contributor

@alamb alamb commented Aug 25, 2021

Which issue does this PR close?

Next part #866

Builds on #938 so review that first

Rationale for this change

We want basic understanding of where a plan's time is spent and in what operators. See #866 for more details

What changes are included in this PR?

  1. Instrument SortPreservingMergeExec using the API from Add BaselineMetrics, Timestamp metrics, add for CoalescePartitionsExec, rename output_time -> elapsed_compute #909

Are there any user-facing changes?

More fields in EXPLAIN ANALYZE are now filled out

@alamb alamb changed the title Add metrics to `SortPreservingMergeExec Add metrics to SortPreservingMergeExec Aug 25, 2021
@alamb alamb changed the title Add metrics to SortPreservingMergeExec Add baselie metrics to SortPreservingMergeExec Aug 26, 2021
@alamb alamb changed the title Add baselie metrics to SortPreservingMergeExec Add baseline metrics to SortPreservingMergeExec Aug 26, 2021
@alamb alamb force-pushed the alamb/annotate_merge_et_al branch from 418072c to be9428a Compare August 26, 2021 12:38
@alamb alamb force-pushed the alamb/annotate_merge_et_al branch from a730a2f to dcc601e Compare August 26, 2021 13:46
@alamb alamb marked this pull request as ready for review August 26, 2021 17:25
Copy link
Contributor

@NGA-TRAN NGA-TRAN left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding these metrics @alamb. I can't wait to play with it.

// Now, validate metrics
let metrics = merge.metrics().unwrap();

assert!(metrics.output_rows().unwrap() > 0);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can verify the exact output_rows here, right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that is a good point. Will do

@alamb alamb merged commit 9a07f1d into apache:master Aug 27, 2021
@alamb alamb deleted the alamb/annotate_merge_et_al branch August 27, 2021 19:34
@houqp houqp added the enhancement New feature or request label Aug 30, 2021
unkloud pushed a commit to unkloud/datafusion that referenced this pull request Mar 23, 2025
H0TB0X420 pushed a commit to H0TB0X420/datafusion that referenced this pull request Oct 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants