Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed to parse date field after upgrade to 7.11.x from 7.10.2 #69382

Closed
Robert-Saiter opened this issue Feb 22, 2021 · 8 comments · Fixed by #70040
Closed

failed to parse date field after upgrade to 7.11.x from 7.10.2 #69382

Robert-Saiter opened this issue Feb 22, 2021 · 8 comments · Fixed by #70040
Assignees
Labels
>bug :Core/Infra/Core Core issues without another label Team:Core/Infra Meta label for core/infra team

Comments

@Robert-Saiter
Copy link

Robert-Saiter commented Feb 22, 2021

We are getting the following error after upgrading from 7.10.2 to 7.11.0 (subsequent update to 7.11.1 did not resolve the issue).

failed to parse date field [1.613970929E12] with format [strict_date_optional_time||epoch_millis]

Mapping is basic and remains unchanged from 7.10.2 configuration.

Fields throwing the error....

        "ProcTime": {
          "type": "date",
          "store": true
        },
        "RcvTime": {
          "type": "date",
          "store": true
        }

We have multiple deployments and only the ones upgraded to 7.11.x are having this issue.

Since nothing on our end changed and I didn't see anything in the 7.11.x breaking changes or release notes I am posting here. Please let me know what I can provide to assist with reproducing or identifying the issue.

Thank you

@Robert-Saiter Robert-Saiter added >bug needs:triage Requires assignment of a team area label labels Feb 22, 2021
@mayya-sharipova mayya-sharipova added the :Core/Infra/Core Core issues without another label label Feb 22, 2021
@elasticmachine elasticmachine added the Team:Core/Infra Meta label for core/infra team label Feb 22, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (Team:Core/Infra)

@mayya-sharipova mayya-sharipova removed the needs:triage Requires assignment of a team area label label Feb 22, 2021
@mayya-sharipova
Copy link
Contributor

@Robert-Saiter Thank you for submitting the issue.
If you have a stack trace, can you please post it here.
If not, it would be helpful to know when does this error happen (are you trying to run some query?).

@Robert-Saiter
Copy link
Author

My apologies, hopefully I did not post in the wrong location. This issue occurs only in Kibana when attempting to pull any data from our existing indexes while on the 7.11.x versions. I posted the error displayed in Kibana above, I can retrieve further logs or info as requested.

@rjernst
Copy link
Member

rjernst commented Feb 23, 2021

Using epoch times in scientific notation was deprecated in 6.6. This was a feature of Joda time that was not carried over into Java time. So it would seem you are using Java dates, though that would have been expected in 7.10 as well (we started using java dates in 7.0 by default).

As Mayya mentioned, the Elasticsearch log messages for the failure would be necessary for us to investigate at all.

/cc @pgomulka

@Robert-Saiter
Copy link
Author

Thank you, I will close this out as it is working as intended. I've notified my internal team about this change and they will need to correct it on their end. I appreciate you taking a look and providing me with these details so quickly.

@pgomulka
Copy link
Contributor

pgomulka commented Mar 2, 2021

@Robert-Saiter can you please report back to use what was causing this on your end? I would like to investigate this more closely but I am not sure how to reproduce this.
Do you know when the index was created? You can check this with https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-settings.html
Also if you still has more logs available, that would help a lot
Thank you

@pgomulka pgomulka reopened this Mar 2, 2021
@pgomulka pgomulka self-assigned this Mar 2, 2021
@nik9000
Copy link
Member

nik9000 commented Mar 8, 2021

We've tracked down a bug from where if you send a date or date_nanos in like 12345.123456 we will bump into this issue if try to fetch the date with fields. #70040 silences the exception but leaves a loss of precision. You can read up on what the loss looks like over there. I think that is what is going on here - kibana uses the fields API with date and date_nanos fields in 7.11.

@nik9000
Copy link
Member

nik9000 commented Mar 8, 2021

I've marked #70040 as closing this one because I'm fairly sure this is about the fields API for that format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Core/Infra/Core Core issues without another label Team:Core/Infra Meta label for core/infra team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants