Fixed local.py not working on Windows. Added GPU acceleration.

[CyanideByte]

Describe the changes you have made:

Updated parts of the local.py profile script so that it would work on Windows too.
Added GPU acceleration.

Reference any relevant issues (e.g. "Fixes #000"):

Pre-Submission Checklist (optional but appreciated):

• I have included relevant documentation updates (stored in /docs)
• I have read docs/CONTRIBUTING.md
• I have read docs/ROADMAP.md

OS Tests (optional but appreciated):

• Tested on Windows
• Tested on MacOS
• Tested on Linux

[KillianLucas]

Nice! Thank you so much for repairing on Windows. My machine can barely run these local models, even Phi-2 + I only have a Mac. Brilliant to add the GPU flags as well.

Also, how do you feel about Phi-2 cyanide? it would be extraordinary if it downloaded a better model depending on the hardware / disk space, but maybe Phi-2 is good for basic usage.

Merging.