New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for List of Maps (Nested objects) #41
Comments
Hmm - I think there's a problem with your data set. You're using a map but have the same key declared twice which is actually illegal (it's not a valid JSON object). |
Costin, Thanks that makes sense. I will hard code map from hive map type [{1 : 3}, {4: 5}] to ES Query String in BufferedRestClient. Thanks for the support. |
Instead of hard-coding why not apply some transformation to the data, such as converting the map to a bag/list? Note that a wrong JSON implies the data might be properly represented in ES which can trigger issues when doing queries. |
Makes sense thanks costin. |
@abhishek376 I'm closing this issue as the problem seems to be fixed. Note that mapping is part of the roadmap to cope with the different data structures however it will take a bit until I get to it. |
For example :
if I have a map type (rdata) column in hive
and when I try to push the data to Elastic search I only see last mapid/value pair in elastic search.
Log for the writable
INFO org.elasticsearch.hadoop.rest.BufferedRestClient: Writable{rid=1, rdata={value=5, mapid=4}, rdate=1234, mapids=[7, 8, 9]}
Any workaround for this ? Is this a bug ?
Thanks
The text was updated successfully, but these errors were encountered: