place models in /switch/chatnx/
reccomended models
https://huggingface.co/bartowski/gemma-2-2b-it-GGUF/resolve/main/gemma-2-2b-it-Q4_K_M.gguf (2tok/s at 2601CPU, smarter model)
https://huggingface.co/unsloth/gemma-3-270m-it-GGUF/resolve/main/gemma-3-270m-it-F16.gguf (8tok/s at 2601CPU, dumb model)
cpu OC is heavily reccomended!