Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alert rule configuration file cannot be automatically loaded #1866

Closed
barnettZQG opened this Issue Aug 2, 2016 · 7 comments

Comments

Projects
None yet
3 participants
@barnettZQG
Copy link

barnettZQG commented Aug 2, 2016

in prometheus config.yml file ,i can see this:
# Load and evaluate rules in this file every 'evaluation_interval' seconds.
but I practice shows that it is not effective。
I use latest version image from docker-hub "prom/prometheus"

Other:
the targets configuration file could be automatically loaded

@matthiasr

This comment has been minimized.

Copy link
Contributor

matthiasr commented Aug 2, 2016

The comment is technically correct but ambiguous. The rules are loaded
once, then evaluated regularly. To reload them, send a SIGHUP to the

Prometheus process.

Matthias Rampke
Engineer

SoundCloud Ltd. | Rheinsberger Str. 76/77, 10115 Berlin, Germany | +49 173
6395215

Managing Director: Alexander Ljung | Incorporated in England & Wales with
Company No. 6343600 | Local Branch Office | AG Charlottenburg | HRB 110657B

fabxc added a commit that referenced this issue Aug 3, 2016

@barnettZQG

This comment has been minimized.

Copy link
Author

barnettZQG commented Aug 3, 2016

thank you for you answer.
but i think that rule cloud be automatic loading is very useful.

@fabxc

This comment has been minimized.

Copy link
Member

fabxc commented Aug 3, 2016

This was a deliberate decision as it was with not reloading the configuration automatically.
Files watches don't show super consistent behavior cross-platform and we don't want to run into issues of loading partial, yet valid, configurations or rule files.

If one is able to deploy a new file, it is equally easy to follow this up with a SIGHUP or a curl to the /-/reload endpoint in general.

@barnettZQG

This comment has been minimized.

Copy link
Author

barnettZQG commented Aug 3, 2016

I restart the prometheus container after modify the rules file,but now prometheus data size over 60GB,so it very slow. Don't know whether normal or not.

@barnettZQG

This comment has been minimized.

Copy link
Author

barnettZQG commented Aug 3, 2016

So now I can use the following two ways:
(1)kill -HUP pid
(2)curl -X POST http://localhost:9090/-/reload

@barnettZQG barnettZQG closed this Aug 3, 2016

@fabxc

This comment has been minimized.

Copy link
Member

fabxc commented Aug 3, 2016

Yes, after a certain size restarts tend to become slower as data has to be checkpointed & loaded.
The reloading is the very fast alternative.

@lock

This comment has been minimized.

Copy link

lock bot commented Mar 24, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Mar 24, 2019

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.