Skip to content

NIFI-11889 Add Record-oriented Transmission to PutTCP#7554

Closed
exceptionfactory wants to merge 1 commit intoapache:mainfrom
exceptionfactory:NIFI-11889
Closed

NIFI-11889 Add Record-oriented Transmission to PutTCP#7554
exceptionfactory wants to merge 1 commit intoapache:mainfrom
exceptionfactory:NIFI-11889

Conversation

@exceptionfactory
Copy link
Copy Markdown
Contributor

Summary

NIFI-11889 Adds a Transmission Strategy property to PutTCP enabling either FlowFile-oriented or Record-oriented processing. The change maintains the current default behavior of FlowFile-oriented processing.

The new Record-oriented strategy requires Record Reader and Record Writer properties, and disables the Message Delimiter and Character Set properties, when configured.

The Record-oriented strategy enables conversion from one record format to another during processing, supporting high-volume flows. Similar results can be achieved using ConvertRecord prior to PutTCP, but supporting record-orienting handling in PutTCP avoids intermediate processing.

It is important to note that record-oriented processing does not provide application-level delivery guarantees. This approach may be suitable for flows that can tolerate data duplication.

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

  • Pull Request based on current revision of the main branch
  • Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • Build completed using mvn clean install -P contrib-check
    • JDK 17

Licensing

  • New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • Documentation formatting appears as expected in rendered files

@greyp9 greyp9 self-requested a review August 4, 2023 15:02
Copy link
Copy Markdown
Contributor

@greyp9 greyp9 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes look good @exceptionfactory - thanks!

@greyp9 greyp9 closed this in 5c577be Aug 4, 2023
greyp9 pushed a commit that referenced this pull request Aug 4, 2023
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants