Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadata change in ES 2.x #715

Closed
costin opened this issue Mar 4, 2016 · 1 comment

Comments

@costin
Copy link
Member

commented Mar 4, 2016

In ES 2.x, metadata can no longer be specified per document but rather per call. This makes things somewhat tricky in terms of bulk indexing since it means different calls need to be made per call

@sachingsachin

This comment has been minimized.

Copy link

commented Mar 29, 2016

We have around 40 storm nodes feeding to a 30-shard, 1-replica-each Elastic-Search cluster.
Without routing, each indexing request from storm is being further divided into 30 shards by the receiving shard.
That means even if we send 30 MB per request, it ends being 1 MB / shard / request.
This is really a performance killer for us.

If we can get routing back, there will be 29 lesser network requests per call and each shard will index 30 MB / request without distributing.
So getting routing to work is really important for us.

Will appreciate if there is some hint on when it is planned to be put back.
I can offer a patch if someone is ready to help me review the same.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.