uncertainty

Bayesian

BNN

Frequentist

MC-Dropout

• an implicit ensemble of multiple stochastic forward passes

Deep Ensemble

• an explicit ensemble of random initialized models of same architecture trained on the same data

SWAG

• an ensemble of historical models during training

Early-exit-Ensemble

Dirichlet

Prior Networks — [Predictive Uncertainty Estimation via Prior Networks]