Instructor: Aaron Schein
TAs: Wei Kuang, Sounak Paul
Term: Spring 2023
The University of Chicago
- Time: Tuesday and Thursday, 3:30am-4:50pm
- Place: Eckhart room 133
- Office hours:
- Wei: Monday 2-3 pm (Jones 304)
- Sounak: Friday 3-4 pm (Jones 308)
- Assignment 1: Bayesian decision theory. Due Monday April 3 at 11:59pm on GradeScope.
- Assignment 2: Logistic regression and beta-binomial updating. Due Monday April 10 at 11:59pm on GradeScope.
- Assignment 3: Exponential families, conjugacy, and entropy. Due Monday April 17 at 11:59pm on GradeScope.
- Assignment 4: HMMs, belief propagation, variable elimination. Due Tuesday May 2 at 11:59pm on GradeScope.
- Suggested readings:
- Freedman (1994): "Some issues in the foundations of statistics"
- Freedman "Notes on the Dutch Book argument"
- Chap 15 "The Navy Searches" of The Theory That Would Not Die (see Canvas for e-copy)
- Materials:
- Suggested readings:
- Chap 1 of Berger (1985) Statistical Decision Theory and Bayesian Analysis (see Canvas for e-copy)
- Suggested readings:
- Chap 2 of Hastie et al. (2009) Elements of Statistical Learning
- Materials:
- Suggested readings:
- David Blei's lecture notes on exponential families
- Suggested readings:
- Fong & Holmes (2020) On the marginal likelihood and cross-validation
- Chap 9.1-9.2 of Murphy (2012) Machine Learning: A Probabilistic Perspective
- Chap 14 of John Duchi's lecture notes on info theory
- Suggested readings:
- Chap 1-2, 4.1-4.3, 5.1-5.3, 8 of MacKay (2005) Information Theory, Inference, and Learning Algorithms
- Wikipedia article on Z-channels
- Suggested readings:
- Chap 2 of Jordan (2003) An Introduction to Probabilistic Graphical Models
- David Blei's lecture notes on PGMs
- Suggested readings:
- Chap 3 and chap 4 of Jordan (2003) An Introduction to Probabilistic Graphical Models
- David Blei's lecture notes on inference in PGMs
- Suggested readings:
- David Blei's lecture notes on inference in PGMs
- Scott Linderman's slides on HMMs
- Ramesh Sridharan's lecture notes on HMMs
- Chap 13 (specifically 13.2.2-13.2.4) of Bishop (2006) Pattern Recognition and Machine Learning
- Suggested readings:
- Chap 9 of Bishop (2006) Pattern Recognition and Machine Learning
- Scott Linderman's slides on EM
- Scott Linderman's slides on HMMs
- Suggested readings:
- Chap 11.1.6-11.3 of Bishop (2006) Pattern Recognition and Machine Learning
- Matthew Stephen's lecture notes on Gibbs sampling
- Scott Linderman's slides on MCMC
- Scott Linderman's slides on Bayesian mixtures