Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#1486] Upgrade kafka images #1691

Merged
merged 7 commits into from
May 7, 2021

Conversation

ljupcovangelski
Copy link
Contributor

@ljupcovangelski ljupcovangelski commented May 3, 2021

required for #1486

@github-actions github-actions bot added the chore label May 3, 2021
@ljupcovangelski ljupcovangelski force-pushed the chore/1486-upgrade-kafka-images branch 2 times, most recently from 2825d5d to 225947c Compare May 4, 2021 11:51
@lucapette lucapette force-pushed the chore/1486-upgrade-kafka-images branch from c01c2ad to 5ace872 Compare May 5, 2021 15:20
@chrismatix chrismatix marked this pull request as ready for review May 6, 2021 12:33
try {
if (!streams.state().equals(KafkaStreams.State.RUNNING)) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prior to KAFKA-10271 the underlying QueryableStoreProvider would expensively lookup stores from all registered StreamThreadStateStoreProvider instances. StreamThreadStateStoreProvider::getStore throws an exception if the thread is not RUNNING so there was an implicit check for that whenever we requested a store.

KAFKA-10271 removed that extra lookup for performance reasons so that it became possible to access stores that would crash when trying to read from them.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This also explains why the integration tests were failing, while the runtime was working: The state stores do eventually get ready, but for the tests that were failing they were not ready at the expected time.

Copy link
Contributor

@lucapette lucapette left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ljupcovangelski ljupcovangelski merged commit 9a2b3c2 into develop May 7, 2021
@ljupcovangelski ljupcovangelski deleted the chore/1486-upgrade-kafka-images branch May 7, 2021 07:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants