Skip to content

NIFI-16120 Add caching for Kubernetes Leader Election Manager#11445

Merged
pvillard31 merged 1 commit into
apache:mainfrom
exceptionfactory:NIFI-16120
Jul 20, 2026
Merged

NIFI-16120 Add caching for Kubernetes Leader Election Manager#11445
pvillard31 merged 1 commit into
apache:mainfrom
exceptionfactory:NIFI-16120

Conversation

@exceptionfactory

Copy link
Copy Markdown
Contributor

Summary

NIFI-16120 Adds caching of current leader status for each role name to the KubernetesLeaderElectionManager using a delegated implementation class.

The caching strategy has a 5 second timeout, aligning with the approach in the ZooKeeper implementation. The cached leader status reduces repeated requests to the Kubernetes REST API when running large numbers of Processors on the Primary Node. The 5 second timeout is less than the current 15 second lease duration, and less than the 10 second renew deadline to avoid artificial extension of existing lease expiration.

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000
  • Pull request contains commits signed with a registered key indicating Verified status

Pull Request Formatting

  • Pull Request based on current revision of the main branch
  • Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • Build completed using ./mvnw clean install -P contrib-check
    • JDK 21
    • JDK 25

Licensing

  • New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • Documentation formatting appears as expected in rendered files

- Configured cache with timeout of 5 seconds for leader status following the pattern of the ZooKeeper implementation

@pvillard31 pvillard31 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @exceptionfactory

@pvillard31
pvillard31 merged commit 0f8d577 into apache:main Jul 20, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants