Skip to content

mattiasvillani/AdvBayesLearnCourse

master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Advanced Bayesian Learning - PhD course


Course information

The typical participant is a PhD student in Statistics or related fields (Mathematical Statistics, Engineering Science, Quantitative Finance, Computer Science, ...). The participants are expected to have taken a basic course in Bayesian methods, for example Bayesian Learning at Linköping University or Bayesian Statistics I at Stockholm University.

Examination and Grades: The course is graded Pass or Fail. Examination is through individual reports on distributed problems for each topic. Many of the problems will require computer implementations of Bayesian learning algorithms.

Course organization The course is organized in four topics, each containing four lecture hours. Course participants will spend most of their study time by solving the problem sets for each topic on their own computers without supervision.

All lectures are given online using Zoom this year.

Welcome!

Mattias Villani
Professor of Statistics, Stockholm and Linköping University


Topic 1 - Gaussian Processes Regression and Classification

Reading: Gaussian Processes for Machine Learning - Chapters 1, 2.1-2.5, 3.1-3.4, 3.7, 4.1-4.3.
Code: GPML for Matlab | GPy for Python | Gausspr in R | Gaussianprocesses.jl in Julia | GPyTorch - GPs in PyTorch
Other material: Visualize GP kernels

Lecture 1 - April 17, hours 10-12
slides
Lecture 2 - April 17, hours 13-15
slides

Lab Topic 1
Problems | Lidar data


Topic 2 - Bayesian Nonparametrics

Reading: Bayesian Data Analysis - Chapter 23 | The Neal (2000) article on MCMC for Dirichlet Process Mixtures

Lecture 3 - April 28, hours 10-12
slides
Lecture 4 - April 28, hours 13-15
slides | derivation marginal Gibbs

Lab Topic 2
Problems | Galaxy data


Topic 3 - Variational Inference

Reading: Blei et al JASA | Tran's VI Notes
Other material: Natural gradient notes | autograd in python | ForwardDiff in Julia

Lecture 5 - May 15, hours 10-12
slides
Lecture 6 - May 15, hours 13-15
slides

Lab Topic 3
Problems | Time series data


Topic 4 - Bayesian Model Inference

Reading (ordered by priority): Bayesian Data Analysis - Chapter 7 | Bayesian predictive methods article | LOO-CV and WAIC article | Bayesian regularization and Horseshoe | Gaussian Processes for Machine Learning - Chapters 5.1-5.4

Lecture 7 - May 29, hours 10-12
slides
Lecture 8 - May 29, hours 13-15
slides

Lab Topic 4
Problems | StudentTRegression.R | StudentTRegression.jl

About

Course material for the PhD course in Advanced Bayesian Learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published