-
Notifications
You must be signed in to change notification settings - Fork 25.5k
Closed
Labels
:Data Management/Ingest NodeExecution or management of Ingest Pipelines including GeoIPExecution or management of Ingest Pipelines including GeoIP>bugTeam:Data ManagementMeta label for data/management teamMeta label for data/management teamv8.18.8v8.19.5v9.0.8v9.1.5v9.2.0
Description
When using the JSON processor the add_to_root
option set, subobject fields are not resolved properly anymore:
POST _ingest/pipeline/_simulate
{
"docs": [
{
"_source": {
"a": { "b": """{"abchild":"abc"}""" },
"d.e": """{"dechild":"abc"}"""
}
}
],
"pipeline": {
"processors": [
{
"json": {
"field": "a.b",
"target_field": "abtarget",
"ignore_failure": true
}
},
{
"json": {
"field": "d.e",
"target_field": "detarget",
"ignore_failure": true
}
}
],
"field_access_pattern": "flexible"
}
}
works fine - in case of "field_access_pattern": "classic"
, detarget
is not written successfully, which is expected.
However
POST _ingest/pipeline/_simulate
{
"docs": [
{
"_source": {
"a": { "b": """{"abchild":"abc"}""" },
"d.e": """{"dechild":"abc"}"""
}
}
],
"pipeline": {
"processors": [
{
"json": {
"field": "a.b",
"add_to_root": true,
"ignore_failure": true
}
},
{
"json": {
"field": "d.e",
"add_to_root": true,
"ignore_failure": true
}
}
],
"field_access_pattern": "flexible"
}
}
only works for d.e
, not for a.b
- this is even the case for "field_access_pattern": "classic"
or omitting it altogether
Metadata
Metadata
Assignees
Labels
:Data Management/Ingest NodeExecution or management of Ingest Pipelines including GeoIPExecution or management of Ingest Pipelines including GeoIP>bugTeam:Data ManagementMeta label for data/management teamMeta label for data/management teamv8.18.8v8.19.5v9.0.8v9.1.5v9.2.0