Tracking the TheBloke and his awesome work
https://quantized.cgeosoft.com
I hacked this project in a few hours at the weekend. It is a simple static site to list quantized llama models provided by TheBloke.
I was constantly checking the TheBloke page to see if there is any new quantized model. As I have already defined the limits of my machine, I was only interested in specific number of parameters but the huggingface page does not provide any filtering option. So I decided to make this project.
I have used Eleventy to generate the static site and Netlify to host it. I have also used Tailwind CSS for styling.