Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Add Prometheus retention duration switch to dynamically respond to disk space's free storage #4092

Closed
phanama opened this Issue Apr 17, 2018 · 2 comments

Comments

Projects
None yet
2 participants
@phanama
Copy link

phanama commented Apr 17, 2018

Proposal

Feature request:
Auto-configure prometheus' retention duration in case of not enough disk space left.
Make a "true"/"false" switch to make Prometheus delete oldest data that are still in its retention duration window (not stale) if it is set to true, until some disk space threshold is achieved to make Prometheus keep running even if its disk space is full (this requires the organization's/users' soft-policy that the oldest non-stale data can be deleted, though).

Use case. Why is this important?:

  • Really helps under the inability to expand disk space due to strict company's/organization's capacity-cost policy.
  • Keep Promeheus running under full disk-space condition without needing operators to notice it, reducing ops-work (while still alerting ops to expand disk size).

Sometimes metrics are quite dynamic (in some use cases, we can add or delete metrics from a running Prometheus), so is its storage space calculation result in https://prometheus.io/docs/prometheus/latest/storage/

@brian-brazil

This comment has been minimized.

Copy link
Member

brian-brazil commented Apr 17, 2018

Dupe of #968.

@lock

This comment has been minimized.

Copy link

lock bot commented Mar 22, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Mar 22, 2019

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.