-
Notifications
You must be signed in to change notification settings - Fork 13.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
KAFKA-15905 Restarts of MirrorCheckpointTask should not permanently i… #15910
Commits on May 9, 2024
-
KAFKA-15905 Restarts of MirrorCheckpointTask should not permanently i…
…nterrupt offset translation MirrorCheckpointTask reloads the last checkpoint at start, OffsetSyncStore stores OffsetSyncs before reading till end. Add test case simulating restarted task where the store is reinitialized with later OffsetSyncs and check that emitted Checkpoint do not rewind. Also addresses KAFKA-16622 Mirromaker2 first Checkpoint not emitted until consumer group fully catches up once because the OffsetSyncStore store is populated before reading to log end. Co-Authored-By: Adrian Preston <prestona@uk.ibm.com>
Configuration menu - View commit details
-
Copy full SHA for 66031ee - Browse repository at this point
Copy the full SHA 66031eeView commit details
Commits on May 10, 2024
-
MirrorCheckpointTask report errors when loading checkpoints
Co-Authored-By: Adrioan Preston <prestona@uk.ibm.com>
Configuration menu - View commit details
-
Copy full SHA for 4ad350f - Browse repository at this point
Copy the full SHA 4ad350fView commit details
Commits on May 14, 2024
-
If CheckpointTask cannot read checkpoints at startup,
use previous OffsetSyncStore "pessimistic" load logic Co-Authored-By: Adrian Preston <prestona@uk.ibm.com>
Configuration menu - View commit details
-
Copy full SHA for 64a60b4 - Browse repository at this point
Copy the full SHA 64a60b4View commit details
Commits on May 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e33edd2 - Browse repository at this point
Copy the full SHA e33edd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2146ed0 - Browse repository at this point
Copy the full SHA 2146ed0View commit details
Commits on May 16, 2024
-
Load checkpoints asynchronously.
Use a wrapper to the checkpointsPerGroup map to ensure thread safety on restart. The callback rethrows the error as a way to stop the KafkaBasedLog looping forever in readtoEnd. This occurs when unauthorized to READ from the topic, as KafkaBasedLog retries indefinitely. Unauthorized to DESCRIBE instead fails immediately before fetching. All such failures result in a warning log message about degraded offset translation.
Configuration menu - View commit details
-
Copy full SHA for 7115d89 - Browse repository at this point
Copy the full SHA 7115d89View commit details
Commits on May 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cc27e4c - Browse repository at this point
Copy the full SHA cc27e4cView commit details -
Configuration menu - View commit details
-
Copy full SHA for e415e67 - Browse repository at this point
Copy the full SHA e415e67View commit details
Commits on May 20, 2024
-
Renamed CheckpointsStore to CheckpointStore
for consistency with OffsetSyncStore CheckpointStore started debug/trace message
Configuration menu - View commit details
-
Copy full SHA for 56db4ed - Browse repository at this point
Copy the full SHA 56db4edView commit details
Commits on May 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 36b7bb1 - Browse repository at this point
Copy the full SHA 36b7bb1View commit details -
Configuration menu - View commit details
-
Copy full SHA for dfeca99 - Browse repository at this point
Copy the full SHA dfeca99View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2fdc9f9 - Browse repository at this point
Copy the full SHA 2fdc9f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9896653 - Browse repository at this point
Copy the full SHA 9896653View commit details
Commits on May 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1d0363b - Browse repository at this point
Copy the full SHA 1d0363bView commit details -
Configuration menu - View commit details
-
Copy full SHA for b6eeaba - Browse repository at this point
Copy the full SHA b6eeabaView commit details