-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update Neyman threshold when changing runner_args #100
Conversation
for more information, see https://pre-commit.ci
I think it would be really neat if the static flag would set itself though I found that this is not really practical for our simple examples and thus I went back to making it a hand-settable flag. |
Pull Request Test Coverage Report for Build 6689997230
💛 - Coveralls |
In principle one could also get around loading the runner explicitly by just obtaining the |
|
||
self._check_ll_and_generate_data_signature() | ||
self.set_nominal_values(**kwargs.get("nominal_values", {})) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is the nearby functionality different from simply using set_nominal_values
? @hammannr
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I had to change it since otherwise the static parameters would complain if the nominal value were updated in this step
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So the outcome is the same. It only had to be changed to accommodate the static parameter functionality
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Then maybe set_nominal_values
is not checked by pytest. Would you add a test to increase the coverage?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually, now it's no longer in use so I would suggest to simply trash the function
Logically the thresholds json should be controlled by runner configuration yaml but not the files stored. But it is still beneficial to check the consistency between Better put this in another PR, as an enhancement. |
For some reason, pre-commit complains about
|
I will try to fix it. |
For shape parameters such as the WIMP mass, we haven't implemented anything that would allow resetting its nominal value after initialization. However, this is done to obtain the
poi_rate_multiplier
for a givenpoi_expectation
, which means that the poi_rate_multiplier values corresponding to a given threshold might be wrong in the end.I did the following to fix this issue and prevent us from running into a similar issue in the future:
NeymanConstructor
. This takes a bit longer and may sometimes be overkill but it works.static
(see Dealing with static shape parameters #81 ), which is true if the parameter is