Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert elasticity commits - bug found with broadcast input #1626

Merged
merged 12 commits into from
Aug 4, 2022

Conversation

lakshmi-manasa-g
Copy link
Contributor

@lakshmi-manasa-g lakshmi-manasa-g commented Aug 4, 2022

Symptom: broadcast input ssp is not consumed by all containers of the job.

cause: elasticity code changing systemconsumers and samza-core

changes:

  1. reverting all elasticity commits post SAMZA-2719: [Elasticity] fix container level metrics when elasticity is enabled #1585 after which this issue was detected.
  2. updating the checkpointv1 serde to accept checkpoints written with SAMZA-2743: [Elasticity] Add keybucket into SSP serde for checkpoint #1608

test: build passes

Usage/upgrade: elasticity will not work
backwards compatible: yes, reverting code.

list of elasticity PRs being reverted -
#1625
#1610
#1608
#1607
#1603
#1598
#1597
#1596
#1589

…when elasticity is enabled"

This reverts commit eaf8252.
…n envelope is finished processing when elasticity is enabled"

This reverts commit 49354c6.
…container starts up using checkpoints from previous deploys when elasticity was enabled"

This reverts commit 2cda174.
…mplement for KafkaCheckpointManager"

This reverts commit 400d197.
…me when elasticity is enabled"

This reverts commit da75b63.
@mynameborat
Copy link
Contributor

Let us document what part of elasticity is reverted and what still is in and what our plan is put these back on.

@mynameborat mynameborat merged commit 0ac55be into apache:master Aug 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants