The code complementing my undergraduate thesis "Alleviating the Low-Rank Softmax Bottleneck".
- Load conda environment or install libraries on your own.
conda env create -f environment.yml
conda activate thesis- Run the experiments. The bash script assumes a Slurm based cluster. If needed, adapt the code accordingly.
cd cluster
bash run_experiments.sh- Run the Jupyter notebook to generate all figures with results.
jupyter notebook generate_figures.ipynb