Setup

• Put your MMLU data folder in /mmlu/data
• (Optional) Create a virtual env (python -m venv myenv , source myenv/bin/activate)
• Run the gen_mmlu.py first, and then look what the JSON that's generated is called and use that within eval_mmlu.py