Skip to content

NIFI-15835 - Flaky test PollingKinesisClientTest.testExpiredIteratorRecoveryDoesNotDeliverSameShardOutOfOrder#11135

Merged
exceptionfactory merged 1 commit intoapache:mainfrom
pvillard31:NIFI-15835
Apr 13, 2026
Merged

NIFI-15835 - Flaky test PollingKinesisClientTest.testExpiredIteratorRecoveryDoesNotDeliverSameShardOutOfOrder#11135
exceptionfactory merged 1 commit intoapache:mainfrom
pvillard31:NIFI-15835

Conversation

@pvillard31
Copy link
Copy Markdown
Contributor

@pvillard31 pvillard31 commented Apr 13, 2026

Summary

NIFI-15835 - Flaky test PollingKinesisClientTest.testExpiredIteratorRecoveryDoesNotDeliverSameShardOutOfOrder

The fetch loop runs with 1-nanosecond backoffs, so on some thread schedules it could complete the entire cycle (fetch seq 200, fetch seq 300, hit ExpiredIteratorException, drain the shard queue, replay from checkpoint) before the test thread's first pollAnyResult call. The drain removed both batches (including the one the test expected to poll first), and the replay batch was consumed by the first poll, leaving nothing for the second poll -- which then returned null after 5 seconds.

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000
  • Pull request contains commits signed with a registered key indicating Verified status

Pull Request Formatting

  • Pull Request based on current revision of the main branch
  • Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • Build completed using ./mvnw clean install -P contrib-check
    • JDK 21
    • JDK 25

Licensing

  • New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • Documentation formatting appears as expected in rendered files

@pvillard31 pvillard31 added the type: testing Pull requests for changes to test components label Apr 13, 2026
@pvillard31 pvillard31 changed the title NIFI-15835 - Flaky test ollingKinesisClientTest.testExpiredIteratorRecoveryDoesNotDeliverSameShardOutOfOrder NIFI-15835 - Flaky test PollingKinesisClientTest.testExpiredIteratorRecoveryDoesNotDeliverSameShardOutOfOrder Apr 13, 2026
Copy link
Copy Markdown
Contributor

@exceptionfactory exceptionfactory left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @pvillard31, this alternative approach looks like a good improvement for test stability. +1 merging

@exceptionfactory exceptionfactory merged commit d2d6e20 into apache:main Apr 13, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type: testing Pull requests for changes to test components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants