Skip to content

[Spark] Some refactoring to clean up OptimisticTransaction #4735

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

ctring
Copy link
Contributor

@ctring ctring commented Jun 10, 2025

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

This PR does the following:

  • Change how needsCheckpoint is set.
  • Avoid using vars in DeltaTransaction trait.
  • DeltaTransaction will be renamed later and become a helper trait to contains miscellaneous stuff, moving some coordinated commits helper methods to there now.

How was this patch tested?

Existing UTs

Does this PR introduce any user-facing changes?

No

Copy link
Collaborator

@LukasRupprecht LukasRupprecht left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for cleaning this up!

@vkorukanti vkorukanti merged commit adce7a4 into delta-io:master Jun 11, 2025
21 of 22 checks passed
@ctring ctring deleted the cuong-nguyen_data/refactor-transaction branch June 11, 2025 23:19
vkorukanti pushed a commit that referenced this pull request Jun 12, 2025
<!--
Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://github.com/delta-io/delta/blob/master/CONTRIBUTING.md
2. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP]
Your PR title ...'.
  3. Be sure to keep the PR description updated to reflect all changes.
  4. Please write your PR title to summarize what this PR proposes.
5. If possible, provide a concise example to reproduce the issue for a
faster review.
6. If applicable, include the corresponding issue number in the PR title
and link it in the body.
-->

#### Which Delta project/connector is this regarding?
<!--
Please add the component selected below to the beginning of the pull
request title
For example: [Spark] Title of my pull request
-->

- [x] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)

## Description

Continue from #4735. This PR
renames `DeltaTransaction` to `TransactionHelper` and some additional
clean-ups.

## How was this patch tested?

Existing UTs

## Does this PR introduce _any_ user-facing changes?

No
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants