Skip to content
/ BASQ Public

(NeurIPS 2022) Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination

License

Notifications You must be signed in to change notification settings

ma921/BASQ

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

79 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

BASQ: Bayesian Alternately Subsampled Quadrature

This repository contains the python code that was presented for the following paper.

[1] Adachi, M., Hayakawa, S., Jørgensen, M., Oberhauser, H., and Osborne, M. A. Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination. Advances in Neural Information Processing Systems 35 (NeurIPS), 2022
NeurIPS proceedings, arXiv, OpenReview

plot

Brief explanation

Animate

We query 100 points in parallel to the true posterior distribution. Colours represent the GP surrogate model trying to approximate the three true posteriors (Ackley, Oscillatory, Branin-Hoo, see Supplementary Figure 4 for details). The black dots in the animated GIF is the proposed points by BASQ for each iteration. At the third iteration, BASQ can capture the whole posterior surface.

Features

  • fast batch Bayesian quadrature
  • GPU acceleration
  • Arbitrary kernel for Bayesian quadrature modelling
  • Arbitrary prior distribution for Bayesian inference

Content

BASQ can sample more diversely and quickly than the existing batch Bayesian Quadrature method (batch WSABI). The data presented in the paper was coded with GPy, which is based on batch WSABI code for comparison. The GPy one is not fast as we won't open but I can share if necessary. Batch WSABI code is here: link

Requirements

  • PyTorch
  • GPyTorch
  • BoTorch

Example & Tutorial

python3 main.py

The example with Gaussian Mixture Likelihood (dim=10) will run. You can also find the detailed tutorial in the folder "Tutorial"

  • 01: How to perform BASQ.ipynb
  • 02: BayesQuad with Arbitrary kernel.ipynb
  • 03: Dealing with log likelihood. WSABI and MMLT modelling.ipynb

Recent our work SOBER extends BASQ for more general framework. We recommend try out SOBER tutorial 05 for fast Bayesian inference. You can also find the detailed example applied to Bayesian model selection:

Cite as

Please cite this work as

@article{adachi2022fast,
  title={Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination},
  author={Adachi, Masaki and Hayakawa, Satoshi and Jørgensen, Martin and Oberhauser, Harald and Osborne, Michael A.},
  journal={Advances in Neural Information Processing Systems 35 (NeurIPS 2022)},
  year={2022}
}

About

(NeurIPS 2022) Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published