MINI Project

Task 1

Pick different epochs and find the error where x_k_tilda is the single iterate x_tilda or the iterate avergae

Task 2

Change x_0 to relate the ||x_k_tilda - x_tilda|| with the number of iterations

Task 3

Change step size, initila step size and alpha

Task 4

Change the batch size

Task 5

Keep changing the value of nu and see how the error changes

Setting up the code

mkdir mini_sgd_project
cd mini_sgd_project
git pull https://github.com/ArkashJ/mini_project_sgd.git
python3 -m venv env
source env/bin/activate
pip install -r requirements.txt

Run the code

python3 run_sgd_experiments.py