Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix SegmentCompletionProtocol to ignore unknown json fields #5376

Merged
merged 3 commits into from May 12, 2020

Conversation

mcvsubbu
Copy link
Contributor

Our compatibility guarantees are around upgrading the controller first
and then the broker and then the server. So, it is possible that the
controller sends a new field in the response (in SegmentCompletionProtocol)
The server should ignore new fields that it does not understand

Our compatibility guarantees are around upgrading the controller first
and then the broker and then the server. So, it is possible that the
controller sends a new field in the response (in SegmentCompletionProtocol)
The server should ignore new fields that it does not understand
@@ -395,6 +396,7 @@ public SegmentStoppedConsuming(Params params) {
public Response() {
}

@JsonIgnoreProperties(ignoreUnknown = true)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line should be added before line 388

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch, thanks

@mcvsubbu
Copy link
Contributor Author

Issue #5359

This change must go into 0.4.0

@mcvsubbu mcvsubbu added backward-incompat Referenced by PRs that introduce or fix backward compat issues release-notes Referenced by PRs that need attention when compiling the next release notes labels May 12, 2020
@mcvsubbu
Copy link
Contributor Author

@haibow please make sure this commit gets into 0.4.0 thanks

@codecov-io
Copy link

Codecov Report

Merging #5376 into master will decrease coverage by 9.46%.
The diff coverage is 69.96%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #5376      +/-   ##
==========================================
- Coverage   66.44%   56.97%   -9.47%     
==========================================
  Files        1075     1079       +4     
  Lines       54773    55004     +231     
  Branches     8168     8237      +69     
==========================================
- Hits        36396    31341    -5055     
- Misses      15700    21190    +5490     
+ Partials     2677     2473     -204     
Impacted Files Coverage Δ
...ot/common/protocols/SegmentCompletionProtocol.java 64.86% <ø> (-29.73%) ⬇️
...data/manager/realtime/DefaultSegmentCommitter.java 0.00% <ø> (-80.00%) ⬇️
...manager/realtime/HLRealtimeSegmentDataManager.java 0.00% <0.00%> (-82.16%) ⬇️
...e/data/manager/realtime/SplitSegmentCommitter.java 0.00% <ø> (-63.64%) ⬇️
...ation/function/AggregationFunctionVisitorBase.java 0.00% <0.00%> (ø)
...startree/executor/StarTreeAggregationExecutor.java 0.00% <0.00%> (-100.00%) ⬇️
...ore/startree/executor/StarTreeGroupByExecutor.java 0.00% <0.00%> (-87.50%) ⬇️
...he/pinot/spi/config/table/StarTreeIndexConfig.java 0.00% <ø> (ø)
...main/java/org/apache/pinot/spi/data/FieldSpec.java 85.60% <0.00%> (-0.66%) ⬇️
.../java/org/apache/pinot/spi/data/TimeFieldSpec.java 90.69% <ø> (+1.80%) ⬆️
... and 394 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d995fe...6f83446. Read the comment docs.

@mcvsubbu mcvsubbu merged commit 9aa9f81 into apache:master May 12, 2020
@mcvsubbu mcvsubbu deleted the json-ignore-on-server branch May 12, 2020 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backward-incompat Referenced by PRs that introduce or fix backward compat issues release-notes Referenced by PRs that need attention when compiling the next release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants