Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nested documents #81

Closed
nmaillard opened this issue Aug 23, 2013 · 5 comments
Closed

Nested documents #81

nmaillard opened this issue Aug 23, 2013 · 5 comments

Comments

@nmaillard
Copy link

Hi everyone

Is there a way to push documents and nested documents to ES through the hive or Pig storage handler. I am kinda unclear how you would go about doing it.
Would it be through the MAPs?
If anyone is kind enough to provide a way or example or file to read.

thanks for this and all the good work

@vvakar
Copy link

vvakar commented Aug 23, 2013

I've been using it with hive, but note it doesn't yet have support for nested documents and upsert. However, maps and structs work fine.
See the instructions here: https://github.com/elasticsearch/elasticsearch-hadoop

On Aug 23, 2013, at 12:34 PM, Nicolas Maillard <notifications@github.commailto:notifications@github.com>
wrote:

Hi everyone

Is there a way to push documents and nested documents to ES through the hive or Pig storage handler. I am kinda unclear how you would go about doing it.
Would it be through the MAPs?
If anyone is kind enough to provide a way or example or file to read.

thanks for this and all the good work


Reply to this email directly or view it on GitHubhttps://github.com//issues/81.

@costin
Copy link
Member

costin commented Aug 23, 2013

Not yet but it is scheduled for the next version (suggestions welcome). As
you pointed out maps are nice vehicle however we need the extra metadata
that identifies the map as a nested document.

On Fri, Aug 23, 2013 at 7:34 PM, Nicolas Maillard
notifications@github.comwrote:

Hi everyone

Is there a way to push documents and nested documents to ES through the
hive or Pig storage handler. I am kinda unclear how you would go about
doing it.
Would it be through the MAPs?
If anyone is kind enough to provide a way or example or file to read.

thanks for this and all the good work


Reply to this email directly or view it on GitHubhttps://github.com//issues/81
.

Costin

@nmaillard
Copy link
Author

Great to hear
thanks for all the hard work
let me know If I can do anything to help out.

Definitly getting, nested children and parent child relations in would be a great plus

costin added a commit that referenced this issue Nov 7, 2013
costin added a commit that referenced this issue Nov 7, 2013
refactor command infrastructure
add internal command templating
improved serialization limiting 'garbage' copies
relates to #66 #85 #81 #69
costin added a commit that referenced this issue Nov 7, 2013
costin added a commit that referenced this issue Nov 7, 2013
costin added a commit that referenced this issue Nov 7, 2013
@costin
Copy link
Member

costin commented Nov 7, 2013

Hi guys,
upsert, parent/child support, routing, timestamp, etc... are now supported in master. I'll update the docs accordingly but in short, use es.mapping.[parent|version|etc...] setting to specify the desired parameter and es.write.operation to chose between index|create|update.

@costin
Copy link
Member

costin commented Feb 6, 2014

Considering the latest additions in 1.3 M2 I think this issue is fixed. Please file a new one if that's not the case.

@costin costin closed this as completed Feb 6, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants