Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TransportNodesAction shouldn't hold on to cluster state #13948

Merged

Conversation

imotov
Copy link
Contributor

@imotov imotov commented Oct 5, 2015

Long running TransportNodesAction requests can retain old cluster states in memory for much longer than needed. This can cause nodes with frequent cluster state updates and long running requests to run out of memory.

This problem is especially pronounced on large tribe nodes that send a large number of node requests and have frequently updated cluster state.

@@ -96,15 +97,16 @@ protected boolean transportCompress() {
private final NodesRequest request;
private final String[] nodesIds;
private final ActionListener<NodesResponse> listener;
private final ClusterState clusterState;
ImmutableOpenMap<String, DiscoveryNode> nodes;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why not just resolve this at the start method and not keep this variable as well?

@bleskes
Copy link
Contributor

bleskes commented Oct 6, 2015

left one question...

@imotov imotov force-pushed the optimize-transport-node-operation-action branch from 099051c to b740d1a Compare October 6, 2015 16:20
@imotov
Copy link
Contributor Author

imotov commented Oct 6, 2015

@bleskes is this what you had in mind?

@bleskes
Copy link
Contributor

bleskes commented Oct 6, 2015

LGTM

@s1monw
Copy link
Contributor

s1monw commented Oct 7, 2015

LGTM too

@s1monw s1monw removed the review label Oct 7, 2015
Long running TransportNodesAction requests can retain old cluster states in memory for much longer than needed. This can cause nodes with frequent cluster state updates and long running requests to run out of memory.
@imotov imotov force-pushed the optimize-transport-node-operation-action branch from b740d1a to ea99d97 Compare October 8, 2015 00:50
@imotov imotov merged commit ea99d97 into elastic:master Oct 8, 2015
@clintongormley clintongormley changed the title TransportNodesAction shouldn't hold to cluster state TransportNodesAction shouldn't hold on to cluster state Oct 15, 2015
@imotov imotov deleted the optimize-transport-node-operation-action branch May 1, 2020 22:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants