Area chart + date_histogram plots extra point on DST

[vikrim1]

Hi, I think I'm seeing a bug with the date histogram. In the gif below, the sharp drop on March 8 isn't represented in the data returned from the server (screenshot below gif).

Request:

{
  "query": {
    "filtered": {
      "query": {
        "query_string": {
          "query": "*",
          "analyze_wildcard": true
        }
      },
      "filter": {
        "bool": {
          "must": [
            {
              "query": {
                "query_string": {
                  "query": "*",
                  "analyze_wildcard": true
                }
              }
            },
            {
              "range": {
                "idxinquiry.performanceDateTime": {
                  "gte": 1398707699271,
                  "lte": 1430243699271
                }
              }
            }
          ],
          "must_not": []
        }
      }
    }
  },
  "size": 0,
  "aggs": {
    "2": {
      "date_histogram": {
        "field": "idxinquiry.eventDateTime",
        "interval": "1w",
        "pre_zone": "-07:00",
        "pre_zone_adjust_large_interval": true,
        "min_doc_count": 1,
        "extended_bounds": {
          "min": 1398707699270,
          "max": 1430243699270
        }
      }
    }
  }
}

Response:

{
  "took": 9,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "failed": 0
  },
  "hits": {
    "total": 5,
    "max_score": 0,
    "hits": []
  },
  "aggregations": {
    "2": {
      "buckets": [
        {
          "key_as_string": "2015-02-23T07:00:00.000Z",
          "key": 1424674800000,
          "doc_count": 1
        },
        {
          "key_as_string": "2015-03-02T07:00:00.000Z",
          "key": 1425279600000,
          "doc_count": 2
        },
        {
          "key_as_string": "2015-03-09T07:00:00.000Z",
          "key": 1425884400000,
          "doc_count": 1
        },
        {
          "key_as_string": "2015-03-16T07:00:00.000Z",
          "key": 1426489200000,
          "doc_count": 1
        }
      ]
    }
  }
}

My guess is that this is somehow related to Daylight Savings Time on March 8. Prior to March 8 the data returned from the server is anchored to 23:00. Starting March 9 (after DST), the data points start being anchored to 00:00. It seems like the visualization is looking for a March 8, 23:00 data point, doesn't find one, and plots it at a value of 0.

Thanks!

[rashidkpc]

Can you post the elasticsearch request and result from the spy panel? You can access via the ^ icon at the bottom of the chart.

[vikrim1]

Hey Rashid, thanks for the reply. I updated the original description.

[rashidkpc]

Thanks, we've confirmed the issue and are looking into fixes.

[rashidkpc]

I can confirm this still occurs, though only happens on the area chart:

[rashidkpc]

Also, there isn't actually another data point there, the chart is just getting dragged down:

[acassaignemondeca]

Hello,

I've monitored that month buckets labels in histograms sometimes wrongly refer to the end of the previous month instead of the beginning of the current month. I think it is related to this DST bug.

Thanks

[rashidkpc]

See the referenced commit directly before your comment.

[chrisdrusso]

I'm still seeing this problem in Kibana 4.4.0. Did this fix make it into version 4.4.0?