Skip to content

NIFI-2825: Fix S2S getPeers flow file count#1084

Closed
ijokarumawak wants to merge 1 commit intoapache:masterfrom
ijokarumawak:nifi-2825
Closed

NIFI-2825: Fix S2S getPeers flow file count#1084
ijokarumawak wants to merge 1 commit intoapache:masterfrom
ijokarumawak:nifi-2825

Conversation

@ijokarumawak
Copy link
Member

@ijokarumawak ijokarumawak commented Sep 30, 2016

  • Added ClusterWorkload message to retrieve workload information from a
    cluster coordinator
  • Use cluster workload to return queued flow file count to site-to-site
    client so that it can calculate distribution of data transfer

Added related unit tests, as well as tested with running NiFi secure/unsecure cluster, and standalone.

- Added ClusterWorkload message to retrieve workload information from a
  cluster coordinator
- Use cluster workload to return queued flow file count to site-to-site
  client so that it can calculate distribution of data transfer
Copy link
Contributor

@bbende bbende left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, tested this with a 2 node cluster and verified that data was distributed evenly until i more heavily loaded one node which caused the other node to receive more of the s2s data, will merge

@asfgit asfgit closed this in 17a36c6 Oct 3, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants