Masked Pre-training and the Marginal Likelihood

In this repository, you can find all the files for running the experiments and obtain the empirical results described in our preprint. Extra details on the usage will be provided here soon.

🥝 Citation

Please, if you use this code, include the following citation:

@inproceedings{MorenoRecasensHauberg23,
  title =  {On Masked Pre-training and the Marginal Likelihood},
  author =   {Moreno-Mu\~noz, Pablo and Recasens, Pol G and Hauberg, S{\o}ren},
  booktitle = {Arxiv preprint arXiv:2306.00520},
  year =   {2023}
}