Skip to content

Add an event handler for ColumnVector.close - #13279

Merged
rapids-bot[bot] merged 2 commits into
NVIDIA:branch-23.06from
abellina:column_vector_evt_handler
May 3, 2023
Merged

Add an event handler for ColumnVector.close#13279
rapids-bot[bot] merged 2 commits into
NVIDIA:branch-23.06from
abellina:column_vector_evt_handler

Conversation

@abellina

@abellina abellina commented May 2, 2023

Copy link
Copy Markdown
Contributor

This adds an event handler for ColumnVector to be invoked when .close() is invoked.

I also made getRefCount public since it is useful for debugging and I couldn't think of a good reason to keep this hidden.

This event handler is used to keep track of what columns are spillable at a time and is part of NVIDIA/cudf-spark#7672.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
@abellina
abellina requested a review from a team as a code owner May 2, 2023 22:03
@github-actions github-actions Bot added the Java Affects Java cuDF API. label May 2, 2023
@abellina abellina added feature request New feature or request Spark Functionality that helps Spark RAPIDS non-breaking Non-breaking change labels May 2, 2023
Comment thread java/src/main/java/ai/rapids/cudf/ColumnVector.java
@abellina

abellina commented May 3, 2023

Copy link
Copy Markdown
Contributor Author

/merge

@jbrennan333 jbrennan333 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@rapids-bot
rapids-bot Bot merged commit f6abfdd into NVIDIA:branch-23.06 May 3, 2023
rapids-bot Bot pushed a commit that referenced this pull request Aug 18, 2023
)

This change adds the exact same API for event handling that was added to the device-side `ColumnVector` here #13279. We are going to need this to make `HostColumnVector`, or a batch of them,  spillable in this spark-rapids feature: NVIDIA/cudf-spark#8882.

Authors:
  - Alessandro Bellina (https://github.com/abellina)

Approvers:
  - Gera Shegalov (https://github.com/gerashegalov)
  - Robert (Bobby) Evans (https://github.com/revans2)

URL: #13898
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature request New feature or request Java Affects Java cuDF API. non-breaking Non-breaking change Spark Functionality that helps Spark RAPIDS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants