Skip to content

Conversation

@anishshri-db
Copy link
Contributor

What changes were proposed in this pull request?

Add schema path in metadata table entry, verify expected version and add operator metadata related test for operator metadata format v2

Why are the changes needed?

Changes needed for version verification and for subsequent integration with state data source reader

Does this PR introduce any user-facing change?

No

How was this patch tested?

Added unit tests

===== POSSIBLE THREAD LEAK IN SUITE o.a.s.sql.execution.streaming.state.OperatorStateMetadataSuite, threads: Idle Worker Monitor for python3 (daemon=true), rpc-boss-3-1 (daemon=true), ForkJoinPool.commonPool-worker-3 (daemon=true), ForkJoinPool.commonPool-worker-2 (daemon=true), shuffle-boss-6-1 (daemon=true), ForkJoinPool.commonPool-worker-1 (daemon=true) =====
[info] Run completed in 26 seconds, 651 milliseconds.
[info] Total number of tests run: 11
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 11, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.

Was this patch authored or co-authored using generative AI tooling?

No

…d version and add operator metadata related test for operator metadata format v2
@anishshri-db anishshri-db changed the title [SPARK-49032] Add schema path in metadata table entry, verify expected version and add operator metadata related test for operator metadata format v2 [SPARK-49032][SS] Add schema path in metadata table entry, verify expected version and add operator metadata related test for operator metadata format v2 Jul 27, 2024
@anishshri-db
Copy link
Contributor Author

@ericm-db @HeartSaVioR - could you PTAL ? thx

Copy link
Contributor

@ericm-db ericm-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@HeartSaVioR HeartSaVioR left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@HeartSaVioR
Copy link
Contributor

Thanks! Merging to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants