SurrealDB
Feature: Add GGUF models support to SurrealML #3160
limcheekin
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The GGUF model is very popular quantized model format that support both CPU and GPU with very active community support.
Some metrics at the time of writing:
Related projects implemented in Rust:
What do you think?
Beta Was this translation helpful? Give feedback.
All reactions