prometheus compation error.

[zhangjianweibj]

version:2.0.0
i create a prometheus in docker sworm env.today i delete service and rebuild.then errors as following:
is this bug has repaired?

level=info ts=2019-03-01T03:33:52.247769236Z caller=main.go:314 msg="Starting TSDB"
level=info ts=2019-03-01T03:33:52.247793123Z caller=targetmanager.go:71 component="target manager" msg="Starting target manager..."
level=info ts=2019-03-01T03:33:52.247697567Z caller=web.go:380 component=web msg="Start listening for connections" address=0.0.0.0:9090
level=warn ts=2019-03-01T03:34:05.714991374Z caller=head.go:317 component=tsdb msg="unknown series references in WAL samples" count=9
level=info ts=2019-03-01T03:34:05.771204077Z caller=main.go:326 msg="TSDB started"
level=info ts=2019-03-01T03:34:05.771284021Z caller=main.go:394 msg="Loading configuration file" filename=/srv/prometheus/prometheus.yml
level=info ts=2019-03-01T03:34:05.804224751Z caller=main.go:371 msg="Server is ready to receive requests."
level=info ts=2019-03-01T05:00:00.035798019Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000
level=error ts=2019-03-01T05:00:01.870978575Z caller=db.go:260 component=tsdb msg="compaction failed" err="persist head block: write compaction: add series: out-of-order series added with label set \"{__name__=\\\"ALERTS\\\",alertname=\\\"PrometheusTargetDown\\\",alertstate=\\\"firing\\\",host=\\\"apt\\\",instance=\\\"10.110.25.119:24231\\\",job=\\\"fluentd\\\",route=\\\"email,salesforce\\\",service=\\\"prometheus\\\",severity=\\\"critical\\\"}\""
level=info ts=2019-03-01T05:00:02.89008793Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000
level=error ts=2019-03-01T05:00:04.658166166Z caller=db.go:260 component=tsdb msg="compaction failed" err="persist head block: write compaction: add series: out-of-order series added with label set \"{__name__=\\\"ALERTS\\\",alertname=\\\"PrometheusTargetDown\\\",alertstate=\\\"firing\\\",host=\\\"apt\\\",instance=\\\"10.110.25.119:24231\\\",job=\\\"fluentd\\\",route=\\\"email,salesforce\\\",service=\\\"prometheus\\\",severity=\\\"critical\\\"}\""
level=info ts=2019-03-01T05:00:06.697309592Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000
level=error ts=2019-03-01T05:00:08.545689495Z caller=db.go:260 component=tsdb msg="compaction failed" err="persist head block: write compaction: add series: out-of-order series added with label set \"{__name__=\\\"ALERTS\\\",alertname=\\\"PrometheusTargetDown\\\",alertstate=\\\"firing\\\",host=\\\"apt\\\",instance=\\\"10.110.25.119:24231\\\",job=\\\"fluentd\\\",route=\\\"email,salesforce\\\",service=\\\"prometheus\\\",severity=\\\"critical\\\"}\""
level=info ts=2019-03-01T05:00:12.581347036Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000
level=error ts=2019-03-01T05:00:14.215737745Z caller=db.go:260 component=tsdb msg="compaction failed" err="persist head block: write compaction: add series: out-of-order series added with label set \"{__name__=\\\"ALERTS\\\",alertname=\\\"PrometheusTargetDown\\\",alertstate=\\\"firing\\\",host=\\\"apt\\\",instance=\\\"10.110.25.119:24231\\\",job=\\\"fluentd\\\",route=\\\"email,salesforce\\\",service=\\\"prometheus\\\",severity=\\\"critical\\\"}\""
level=info ts=2019-03-01T05:00:22.238724562Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000
level=error ts=2019-03-01T05:00:23.910786412Z caller=db.go:260 component=tsdb msg="compaction failed" err="persist head block: write compaction: add series: out-of-order series added with label set \"{__name__=\\\"ALERTS\\\",alertname=\\\"PrometheusTargetDown\\\",alertstate=\\\"firing\\\",host=\\\"apt\\\",instance=\\\"10.110.25.119:24231\\\",job=\\\"fluentd\\\",route=\\\"email,salesforce\\\",service=\\\"prometheus\\\",severity=\\\"critical\\\"}\""
level=info ts=2019-03-01T05:00:39.948742201Z caller=compact.go:361 component=tsdb msg="compact blocks" count=1 mint=1551405600000 maxt=1551412800000

[simonpasquier]

You want to update to a newer version of Prometheus as v2.0.0 is quite old.

I'm closing it for now. If you have further questions, please use our user mailing list, which you can also search.