Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ARCTIC-1295] fix writing into an empty KeyedTable with flink/spark 0.3.x/0.4.0 and AMS 0.4.1 #1296

Merged
merged 2 commits into from
Mar 29, 2023

Conversation

wangtaohz
Copy link
Contributor

Why are the changes needed?

fix #1295

Brief change log

  • table with currentTxId == 0 should be valid for allocating TxId from AMS

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduces a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@wangtaohz wangtaohz added this to the Release 0.4.1 milestone Mar 28, 2023
@github-actions github-actions bot added module:ams-server Ams server module module:ams-dashboard Ams dashboard module labels Mar 28, 2023
@wangtaohz wangtaohz added priority:critical and removed module:ams-server Ams server module module:ams-dashboard Ams dashboard module labels Mar 28, 2023
@codecov
Copy link

codecov bot commented Mar 28, 2023

Codecov Report

Patch coverage: 77.77% and project coverage change: -24.64 ⚠️

Comparison is base (559a6ae) 52.65% compared to head (1bb925e) 28.02%.

Additional details and impacted files
@@              Coverage Diff              @@
##             master    #1296       +/-   ##
=============================================
- Coverage     52.65%   28.02%   -24.64%     
- Complexity      522     4865     +4343     
=============================================
  Files            43      652      +609     
  Lines          3705    67116    +63411     
  Branches        354     7821     +7467     
=============================================
+ Hits           1951    18811    +16860     
- Misses         1623    46426    +44803     
- Partials        131     1879     +1748     
Flag Coverage Δ
core 28.02% <77.77%> (?)
trino ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...om/netease/arctic/ams/server/utils/UpdateTool.java 0.00% <0.00%> (ø)
...rctic/ams/server/service/impl/JDBCMetaService.java 68.80% <83.33%> (ø)
.../server/service/impl/ArcticTransactionService.java 79.16% <100.00%> (ø)

... and 692 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions github-actions bot added module:ams-server Ams server module module:ams-dashboard Ams dashboard module labels Mar 28, 2023
Copy link
Contributor

@zhoujinsong zhoujinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@zhoujinsong zhoujinsong merged commit 7b5b3e7 into apache:master Mar 29, 2023
@wangtaohz wangtaohz deleted the fix-1295 branch March 29, 2023 01:50
zhoujinsong pushed a commit that referenced this pull request May 31, 2023
….3.x/0.4.0 and AMS 0.4.1 (#1296)

* table with currentTxId == 0 shoule be valid for allocate TxId from AMS

* valid/invalid KeyedTable for allocating transaction id after table created/dropped
ShawHee pushed a commit to ShawHee/arctic that referenced this pull request Dec 29, 2023
….3.x/0.4.0 and AMS 0.4.1 (apache#1296)

* table with currentTxId == 0 shoule be valid for allocate TxId from AMS

* valid/invalid KeyedTable for allocating transaction id after table created/dropped
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug]: flink/spark in 0.3.x/0.4.0 can't write into an empty KeyedTable if AMS in 0.4.1
2 participants