Simple Python + Unity automation tool to automatically generate shaders in HLSL code based off of a customized AI model
This project was created to simplify the process of generating shaders for Unity using natural language descriptions. It is essentially an automation experiment, as well as an educational project so that I could learn more about API usage, LLM inference/finetuning/compression, Python subprocesses,and full-stack web development.
You may import your own models or download them locally via Ollama (which should be completely free with some usage limits), but the default models used are cloud version as they are generally a bit faster depending on your hardware. There is also an option to used a quantized 5-bit version of Qwen2.5-Coder that I finetuned specifically for writing HLSL shaders in Unity, and this works to varying effect depending on prompt and the nature of the shader you are trying to create.