This package is a GGUF (GPT-Generated Unified Format) file caller.
pip install gguf-core
pip install gguf-core --upgrade
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
gguf -h
gguf -v
with command-line interface
gguf c
with graphical user interface
gguf g
with vision model supported
gguf v
selection menu for connector interface(s) above
gguf i
read model metadata for detail(s)
gguf r
or try model analyzor (beta)
gguf a
GGUF file(s) in the current directory will automatically be detected by the caller.
get GGUF from URL; clone/download it to the current directory
gguf get [url]
You can either use the get feature above or opt a sample GGUF straight from the sample list by:
gguf s
Download ComfyUI GGUF portable package by:
gguf comfy
You can now load your PDF file(s) straight into the model for generating digested summary; try it out by:
gguf p
You can speak/talk straight to GGUF right away; prompt WAV(s) into the model for feedback; try it out by:
gguf f
more accurate (via google Open api); Internet access needed; try it out by:
gguf o
gguf io
gguf us