A fastApi wrapper for moshi LLM
docker build -t moshi -f moshi-cpu.dockerfile .
docker run -v "$(pwd):/root/.cache/huggingface/hub" --env "HF_TOKEN=" -p 9800:9800 moshi
we HTML folder where you can open with browser and you can start chating
-
Notifications
You must be signed in to change notification settings - Fork 0
A FastAPI realtime websocket streaming moshi LLM
License
programmerraja/FastAPI_Moshi
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A FastAPI realtime websocket streaming moshi LLM
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published