Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.
Sign upprometheus data loss problem #2320
Comments
This comment has been minimized.
This comment has been minimized.
|
Hi, I am not able to understand the issue here correctly. Are you telling that even if you increase the retention to 18d you are losing data that we persisted before the restart? |
This comment has been minimized.
This comment has been minimized.
|
@brian-brazil This can be closed as it looks like a usage question and is quite old. |
brian-brazil
closed this
Jun 14, 2017
This comment has been minimized.
This comment has been minimized.
lock
bot
commented
Mar 23, 2019
|
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
lock
bot
locked and limited conversation to collaborators
Mar 23, 2019
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
coffeehc commentedJan 5, 2017
Recently our prometheus data loss problem occurs, every 5 minutes to lose part of the data
View code is mainly due to the data storage time has been more than 15d, at this time call func (s * MemorySeriesStorage) maintainArchivedSeries (fp model.Fingerprint, beforeTime model.Time) method, triggered the delete expired data, but I found deleted When the current collection of data has not been stored.
Next, I set the storage.local.retention 18d, there is no current data loss problem
I would like to ask what is the distribution of the problem?
Linux 3.10.0-229.el7.x86_64 x86_64 800G SSD
prometheus, version 1.4.1 (branch: master, revision: 2a89e87)
build user: root@e685d23d8809
build date: 20161128-09:59:22
go version: go1.7.3