NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka#9942
NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka#9942exceptionfactory merged 2 commits intoapache:mainfrom
Conversation
|
This is really helpful Pierre and lets people inject any/all kafka metadata into the records against their original schema as they might wish. I intent to verify some behavior soon and will share results but by all means somoene else reviewing first go for it |
exceptionfactory
left a comment
There was a problem hiding this comment.
Thanks for the work on this additional output strategy @pvillard31! The general implementation looks good. I noted several minor recommendations, and highlighted one case where null handling was unclear.
...ation/src/test/java/org/apache/nifi/kafka/processors/ConsumeKafkaInjectMetadataRecordIT.java
Show resolved
Hide resolved
...ation/src/test/java/org/apache/nifi/kafka/processors/ConsumeKafkaInjectMetadataRecordIT.java
Outdated
Show resolved
Hide resolved
...apache/nifi/kafka/processors/consumer/convert/AbstractRecordStreamKafkaMessageConverter.java
Outdated
Show resolved
Hide resolved
...apache/nifi/kafka/processors/consumer/convert/AbstractRecordStreamKafkaMessageConverter.java
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Outdated
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Outdated
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Outdated
Show resolved
Hide resolved
...rs/src/main/java/org/apache/nifi/kafka/processors/producer/wrapper/InjectMetadataRecord.java
Outdated
Show resolved
Hide resolved
|
the change from a user pov looks good and lets us inject the kafkaMetadata into the record nicely. the verify method is broken but seems unrelated. I'm good with this if @exceptionfactory feedback is otherwise good |
exceptionfactory
left a comment
There was a problem hiding this comment.
Thanks for making the adjustments @pvillard31, and thanks for the review @joewitt, I agree that the latest implementation looks good. +1 merging
Summary
NIFI-14566 - Introduce Inject Metadata Output Strategy in ConsumeKafka
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking
Pull Request Tracking
NIFI-00000NIFI-00000Pull Request Formatting
mainbranchVerification
Please indicate the verification steps performed prior to pull request creation.
Build
mvn clean install -P contrib-checkLicensing
LICENSEandNOTICEfilesDocumentation