Final project of Mathematical Introduction to Machine Learning
conda create -n grokking python=3.9
conda activate grokking
[Conda] conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
[Pip] pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
(Alternatively, install a different version of PyTorch according to your settings.)
pip install tqdm matplotlib einops
Change the hyper-parameters as you like.
python grok/training.py --training_fraction 0.5 --max_steps 100000
python scripts/Subtask_x.py