New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
ApproximateGP compatibility #347
Comments
While approximate GPs should work with the standard model/posterior API, we haven鈥檛 actually used/tested them extensively. I鈥檓 currently traveling, will take a look at the specific issue here incentive I get back. |
OK so upon further digging it seems that this particular failure you're running into has to do with caching cholesky factors inside gpytorch. Specifically, if I manually compute the cholesky factor for |
This may be related to cornellius-gp/gpytorch#10 |
Let me take a look and see if this is on our end -- in general we believe the variational code is as stable as the exact code at this point, but there may be some issue related to multiple batches or some other particularly complicated use case. |
yeah I guess something funky must be going on with the caching here, if you look at the screenshot |
Yeah, it is cached: but the thing is we would not expect the size of |
Thanks for the help everyone. If manually computing the Cholesky factor gives the correct size, is there a straightforward way to do this with the GPyTorch or BoTorch API? Just to reiterate, my goal is to map multidimensional heteroskedastic inputs to multidimensional homoskedastic outputs. Is there an easier way to do this? It seems variational methods are the go-to for this. |
This is also needed to support the BernoulliLikelihood, which only works with ApproximateGP. |
@thomasahle Here is a simple demo for using the BoTorch acquisition function & optimization machinery with an Approximate GP with Bernoulli Likelihood (model taken from the gpytorch tutorial): For the basic use case, this is as simple as
The |
@cisprague as Jake said, #1047 will probably fix at least part of this issue. |
I'm going to close this for now as this should work fine when not using the |
馃悰 Bug:
gpytorch.models.ApproximateGP
compatibilityTo reproduce
** Code snippet to reproduce **
** Stack trace/error message **
Expected Behavior
BoTorch should be compatible with any GPyTorch model via inhereting from
botorch.models.gpytorch.GPyTorchModel
, but this does not seem to work in the case of agpytorch.models.ApproximateGP
with a variational strategy. It should work like other models do.I am trying to model a mapping from
n x d
heteroskedastic inputs ton x m
homoskedastic outputs.System information
Please complete the following information:
Additional context
Using a mobile robot, with growing position uncertainty, to build an environmental map with sensors.
The text was updated successfully, but these errors were encountered: