Start with setting up the directory.
git clone https://github.com/h4shy/convert-hf-to-gguf
Then navigate to convert-hf-to-gguf and do:
git clone https://github.com/ggml-org/llama.cpp
python -m venv venv
./venv/Scripts/activate
pip install -r requirements.txt
Now move your model directory to convert-hf-to-gguf, or clone it.
That's it, run the script and follow instructions, most of them are skippable if you don't care 💀:
python convert_to_gguf.py