Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ES|QL: support nested fields #107434

Open
thomasneirynck opened this issue Apr 12, 2024 · 2 comments
Open

ES|QL: support nested fields #107434

thomasneirynck opened this issue Apr 12, 2024 · 2 comments
Labels
:Analytics/ES|QL AKA ESQL >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@thomasneirynck
Copy link
Contributor

thomasneirynck commented Apr 12, 2024 •
edited

Description

ES|QL should support nested-fields.

Consider something along the lines of:

  • A command to unpack a nested fields into rows.

e.g.:
FROM foobar | EXPAND my_nested_field by_path "pathtonestedfield | ...

This would yield a denormalized table, something like

foobar1-fieldX, foobar1-fieldY, ..., childa
foobar1-fieldX, foobar1-fieldY, ..., childb
foobar2-fieldX, foobar2-fieldY, ..., childa
foobar2-fieldX, foobar2-fieldY, ..., childb
foobar2-fieldX, foobar2-fieldY, ..., childc
...
  • New/overloaded aggregations that support a path-parameter

e.g.

FROM foobar | STAT avg_nested(my_nested_field, "child_path") BY ...
  • ... or any other number of approaches

A downstream benefit is that nested-field support in ES|QL would immediately enable visualization support for them in Kibana (elastic/kibana#1084)
@thomasneirynck thomasneirynck added >enhancement needs:triage Requires assignment of a team area label labels Apr 12, 2024
@thomasneirynck
Copy link
Contributor Author

This is similar to #105637

@thomasneirynck thomasneirynck mentioned this issue Apr 12, 2024
Open
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Apr 15, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine removed the needs:triage Requires assignment of a team area label label Apr 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
:Analytics/ES|QL AKA ESQL >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@thomasneirynck @williamrandolph @elasticsearchmachine