Finetuning of Falcon-7b, ROC is an Average D&D player, present it a situation, it will explain the thought process of an average player.
Everything you need to run this is on the QLoRA-ROC.ipynb jupyter notebook. I kept logs to show some results. The start.sh file is a fix for BitsAndBytes to run before using the notebook.