Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
What happens when the range of parameters changes? #822
Suppose I run a study with some parameters, e.g.
If I restart my study with
But if the type of the observations change (numerical / categorical), I don't think it will work.
If the range is simply expanded, I think (from my understanding of the code) that TPESampler will just be able to use the observations. Am I correct?
What if the range is shrunk (or shifted)? The problem is that the previous observations are not restricted to the current distribution range, so at least there will problems with
It's up to each sampler how to handle these dynamic changes and we currently have no means to control it universally. As for the TPE sampler.
Changing 1. to only look at parameter-value pairs within the current range would probably make more sense as you say. I'm not so sure about handling new types. In my understanding, users might casually want to resume studies with slightly adjusted ranges, but are the cases besides those?
Hi, thank you very much for your answer.
I think 1. is good as it exploits all available information.
This behavior seems very logical. It could just be documented.