Skip to content

NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka#9942

Merged
exceptionfactory merged 2 commits intoapache:mainfrom
pvillard31:NIFI-14566
May 14, 2025
Merged

NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka#9942
exceptionfactory merged 2 commits intoapache:mainfrom
pvillard31:NIFI-14566

Conversation

@pvillard31
Copy link
Contributor

Summary

NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

  • Pull Request based on current revision of the main branch
  • Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • Build completed using mvn clean install -P contrib-check
    • JDK 21

Licensing

  • New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • Documentation formatting appears as expected in rendered files

@joewitt
Copy link
Contributor

joewitt commented May 13, 2025

This is really helpful Pierre and lets people inject any/all kafka metadata into the records against their original schema as they might wish. I intent to verify some behavior soon and will share results but by all means somoene else reviewing first go for it

Copy link
Contributor

@exceptionfactory exceptionfactory left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the work on this additional output strategy @pvillard31! The general implementation looks good. I noted several minor recommendations, and highlighted one case where null handling was unclear.

@joewitt
Copy link
Contributor

joewitt commented May 14, 2025

the change from a user pov looks good and lets us inject the kafkaMetadata into the record nicely.

the verify method is broken but seems unrelated. I'm good with this if @exceptionfactory feedback is otherwise good

Copy link
Contributor

@exceptionfactory exceptionfactory left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making the adjustments @pvillard31, and thanks for the review @joewitt, I agree that the latest implementation looks good. +1 merging

@exceptionfactory exceptionfactory merged commit 8476866 into apache:main May 14, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants