Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unknown field [missing] in terms in transforms #48243

Open
akleandrov opened this issue Oct 18, 2019 · 4 comments
Open

Unknown field [missing] in terms in transforms #48243

akleandrov opened this issue Oct 18, 2019 · 4 comments

Comments

@akleandrov
Copy link

akleandrov commented Oct 18, 2019

"reason": "[1:500] [data_frame_terms_group] unknown field [missing], parser not found"

PUT _data_frame/transforms/testconc
{
  "source": {
    "index": "from"
  },
  "pivot": {
    "group_by": {
      "period": {
        "terms": {
          "field": "period"
        }
      },
      "nullablefield": {
        "terms": {
          "field": "myfield",
          "missing": "n/a"
        }
      }
    },
    "aggregations": {
      "u": {
        "sum": {
          "field": "u"
        }
      }
    }
  },
  "dest": {
    "index": "trindex"
  },
  "frequency": "5m",
  "sync": {
    "time": {
      "field": "createdAt",
      "delay": "30s"
    }
  }
}

ES 7.4 (original elasticsearch image)

@iverase iverase added the :ml/Transform Transform label Oct 21, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

@benwtrent
Copy link
Member

@akleandrov missing is currently not supported in transforms. But it seems like a good enhancement.

@akleandrov
Copy link
Author

@benwtrent However, the documentation does not indicate that the terms in transformations work with restrictions. Will this be supported in the future?

@benwtrent
Copy link
Member

@akleandrov transforms is built on top of Composite Aggregations.

From what I can tell, missing is not currently supported in Composite aggregations. So, it might take some time before we see it supported in transforms.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants