BGLLM V1: https://huggingface.co/bugatt/BGLLM
I fine tuned Qwen 7B as practice.
Base model: unsloth/Qwen2.5-7B-Instruct-bnb-4bit
Fine-tuned with: amphora/QwQ-LongCoT-130K
In the future, I will:
- Dataset Cleaning
- Fine-tuning with Math Olympiad, coding and SWE-bench datasets