Skip to content

GGUF and Higgs Experimental Models, Unified Model Serving

Latest

Choose a tag to compare

@liampetti liampetti released this 14 Jul 09:42
  • GGUF models can be loaded in for ASR and TTS
  • Higgs TTS v3 (GGUF) version can be loaded in if you want to experiment with emotions
  • Local SLM models are now all loaded in through the 'local' unified in process llama server
  • Lots of other fixes, changes etc. etc. etc.