Expectation-Maximization and MNIST

Introduction

This is an assignment project in STA243 from UC Davis Statistic Department. The purpose of this repository is to enhance the understanding of EM algorithm introduced in class by implementing it to classify real world digits using R. Any errors are mine.

Work in Progress

There are lots of places to improve. Currently, I am running only for 20 iterations. I need to find a way to speed up the code. Just like anything else in life, implementing this algorithem is much more difficult than just nodding my head during the lecture.

The accuracy is rather low when using Diagonal Gaussian Mixture to implement this algorithm.

Resources

1. Load MNIST data in R
2. Useful notes 1
3. Useful notes 2
4. Images Data Source

Acknowlegement

My project partner: Yulu Jin, who pointed out some serious flaws in my code.