Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

regression: writing to elasticsearch failing with exception #133

Closed
nahap opened this Issue Feb 5, 2014 · 4 comments

Comments

Projects
None yet
2 participants
@nahap
Copy link

commented Feb 5, 2014

Writing to elasticsearch fails with the latest version of elasticsearch-hadoop (master) with the exception:

14/02/05 16:35:27 ERROR ql.Driver: FAILED: SemanticException Don't know how to create Settings from configuration null
org.apache.hadoop.hive.ql.parse.SemanticException: Don't know how to create Settings from configuration null
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:5256)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:7428)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:7320)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:8123)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:8349)
    at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:278)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:441)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:342)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:978)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Caused by: java.lang.IllegalArgumentException: Don't know how to create Settings from configuration null
    at org.elasticsearch.hadoop.cfg.SettingsManager.loadFrom(SettingsManager.java:56)
    at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:83)
    at org.apache.hadoop.hive.ql.plan.TableDesc.getDeserializer(TableDesc.java:79)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:5246)
    ... 20 more

the latest working version is git hash 129854d

to reproduce the error , create a table and write data to it with the newest master build:

CREATE EXTERNAL TABLE andy.test_es_hadoop (
    product_id BIGINT)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'test_index/product',
              'es.host'='localhost');

INSERT OVERWRITE TABLE andy.test_es_hadoop
SELECT product_id
FROM  foo limit 1;

costin added a commit that referenced this issue Feb 5, 2014

@costin

This comment has been minimized.

Copy link
Member

commented Feb 5, 2014

Really weird - all the tests do that but the bug does not occur. Maybe it's a difference between local and remote Hive. Either way, I've pushed a fix - can you please give it a quick spin?

Thanks!

@nahap

This comment has been minimized.

Copy link
Author

commented Feb 5, 2014

It works properly now with no exception, thanks!

@costin

This comment has been minimized.

Copy link
Member

commented Feb 5, 2014

Awesome!

@costin

This comment has been minimized.

Copy link
Member

commented Feb 5, 2014

Please keep hammering the code base - it seems you have a gift for finding bugs despite the close to 1K test suite :)

@costin costin closed this Feb 5, 2014

@costin costin added bug labels Mar 4, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.