Skip to content

Conversation

@erenavsarogullari
Copy link
Member

Which issue does this PR close?

Closes #9937.

What changes are included in this PR?

Currently, IPCWriter metrics types are u64 based but source values are based on usize so this requires redundant casting on IPCWriter.write() and ExternalSorter.spill(). On the other hand, another benefit of usize is that it guarantees to reference enough memory location by depending on the architecture such as u32 or u64.
Ref Discussion: #9885 (comment)

Are these changes tested?

Yes by using existing UT case such as SortExec.test_sort_spill

Are there any user-facing changes?

No

Copy link
Contributor

@phillipleblanc phillipleblanc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with @phillipleblanc -- nice!

Thank you for the clean up @erenavsarogullari

@alamb alamb merged commit acd9865 into apache:main Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Convert IPCWriter metrics from u64 to usize

3 participants