Skip to content
Matlab Code for Variational Gaussian Copula Inference
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
VGC-BivariateLogNormal
VGC-FlexibleMargins
VGC-HorseshoeShrinkage
VGC-PoissonLogLinear
figure
LICENSE
README.md

README.md

Variational Gaussian Copula Inference

We use Gaussian copulas (combined with fixed/free-form margins) as automated inference engines for variational approximation in generic hierarchical Bayesian models (the only two model-specific terms are the log likelihood & prior term and its derivatives). We evaluate the peculiarities reproduced in the univariate margins and the posterior dependence captured broadly across latent variables.

Matlab code for the paper

Shaobo Han, Xuejun Liao, David B. Dunson, and Lawrence Carin, "Variational Gaussian Copula Inference", The 19th International Conference on Artificial Intelligence and Statistics (AISTATS 2016), Cadiz, Spain, May, 2016

Examples

Demo 1: Marginal Adaptation (Skew normal, Student's t, Beta, Gamma)

>> demo_SkewNormal
>> demo_StudentT
>> demo_Gamma
>> demo_Beta

The accuracy of marginal approximation for real, positive real, and truncated [0,1] variables is shown as follows,


Demo 2: Bivariate Log-Normal

>> demo_BivariateLN

We approximate bivariate log-normal distributions using a bivariate Gaussian copula with (1) fixed-form log-normal distributed margins (2) free-form Bernstein polynomial based margins,


Demo 3: Horseshoe Shrinkage

Baseline comparisons include:

  • Gibbs sampler
  • Mean-field VB
  • VGC-LN-full: Gaussian copula with log-normal margins
  • VGC-LN-diag: Independence copula with Log-normal margins
  • VGC-BP-full: Gaussian copula with Bernstein polynomial margins
>> demo_Horseshoe


Demo 4: Poisson Log-Linear Regression

MCMC sampler is implemented in JAGS:

>> demo_JAGS_PoissonLogLinear

Variational Gaussian copula (VGC) inference:

>> demo_VGC_PoissonLogLinear

The univaraite margins and pairwise posteriors (JAGS v.s. VGC-BP) are shown below:


Citations

If you find this code helpful, please cite the work using the following information:

@inproceedings{VGC_2016,
  title={Variational Gaussian Copula Inference},
  author={Shaobo Han and Xuejun Liao and David B. Dunson and Lawrence Carin},
  booktitle={The 19th International Conference on Artificial Intelligence and Statistics (AISTATS)},
  year={2016},
}
You can’t perform that action at this time.