Promtool test rules - out of order sample on v2.6.0 but worked on v.2.5.0

[kentsanggds]

Bug Report

What did you do?
Ran promtool test rules <rule test file>

Rules file - https://github.com/alphagov/prometheus-aws-configuration-beta/blob/4dfb2058b805bb6dee32eb4fbc129d4be14bf70c/terraform/modules/app-ecs-services/config/alerts-tests/test-observe-alerts.yml

What did you expect to see?

Tests passing, they were passing on Prometheus v2.5.0

What did you see instead? Under which circumstances?

Tests failed with - out of order sample

Environment

• System information:

  insert output of uname -srm here

Darwin 17.7.0 x86_64

• Prometheus version:

  insert output of prometheus --version here

prometheus, version 2.6.0 (branch: non-git, revision: non-git)
  build user:       brew@HighSierra.local
  build date:       20181220-02:53:59
  go version:       go1.11.4

[codesome]

#4851 might possibly be the reason, not sure, will have a look at it soon.

[simonpasquier]

Closed by #5069

[kentsanggds]

has this been fixed?

[codesome]

@kentsanggds Yes, the fix is included in v2.6.1 (released yesterday).

[kentsanggds]

Great, will try it out