NIFI-2567: Site-to-Site to send large data via HTTPS#857
Closed
ijokarumawak wants to merge 1 commit intoapache:masterfrom
Closed
NIFI-2567: Site-to-Site to send large data via HTTPS#857ijokarumawak wants to merge 1 commit intoapache:masterfrom
ijokarumawak wants to merge 1 commit intoapache:masterfrom
Conversation
- It couldn't send data larger than about 7KB due to the mis-use of httpasyncclient library - Updated httpasyncclient from 4.1.1 to 4.1.2 - Let httpasyncclient framework to call produceContent multiple times as it gets ready to send more data via SSL session - Added HTTPS test cases to TestHttpClient, which failed without this fix
Contributor
|
Reviewing... |
Contributor
|
@ijokarumawak this looks good! Tested by having data generated and pushed back to own 3-node cluster. Once received the data went to an Output Port so that I could pull it back through the same Remote Process Group. The generated data came in 4 sizes: 0 bytes, 1 KB, 1 MB, 50 MB. Was able to push (and pull back) around 1 million FlowFiles and several GB in 5 mins. Great work! +1 merged to master. |
Contributor
|
@ijokarumawak unfortunately, I did forget to put the "This closes #857" in the commit message, so please close this PR when you get a chance. |
Member
Author
|
@markap14 Thanks for reviewing and merging this! Closing the PR. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
httpasyncclient library
it gets ready to send more data via SSL session
fix
I've tested using two secured NiFi clusters, confirmed it can send few hundreds MB files.