New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AggregationSpout fails with default value of es.status.bucket.field == _routing #521

Closed
sebastian-nagel opened this Issue Dec 14, 2017 · 1 comment

Comments

Projects
None yet
2 participants
@sebastian-nagel
Collaborator

sebastian-nagel commented Dec 14, 2017

AggregationSpout fails if using the default value of es.status.bucket.field:

2017-12-13 15:33:16.524 c.d.s.e.p.AggregationSpout elasticsearch[_client_][listener][T#1] [ERROR] Exception with ES query
org.elasticsearch.transport.RemoteTransportException: [jH2OwBx][127.0.0.1:9300][indices:data/read/search]
Caused by: org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed
...
Caused by: org.elasticsearch.common.io.stream.NotSerializableExceptionWrapper: : Fielddata is not supported on field [_routing] of type [_routing]
        at org.elasticsearch.ElasticsearchException.guessRootCauses(ElasticsearchException.java:618) ~[stormjar.jar:?]

The default value _routing is set in AbstractSpout:

    /** Field name to use for aggregating **/
    protected static final String ESStatusBucketFieldParamName = "es.status.bucket.field";
    ...
        partitionField = ConfUtils.getString(stormConf,
                ESStatusBucketFieldParamName, "_routing");

It's used both by AggregationSpout and CollapsingSpout.

@jnioche

This comment has been minimized.

Member

jnioche commented Dec 14, 2017

the example config file uses a different value but you are right that the default value in the code should be the same. Will fix it. Thanks

@jnioche jnioche added this to the 1.8 milestone Dec 14, 2017

@jnioche jnioche closed this in a3c1686 Dec 14, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment