Skip to content

grctest/FastAPI-BitNet

Error
Looks like something went wrong!

About

Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.

hub.docker.com/repository/docker/grctest/fastapi_bitnet

Topics

python docker benchmarking inference 1-bit bitnet perplexity uvicorn fastapi multi-chat server-orchestration llm model-context-protocol

Resources

Readme

License

MIT license
Activity

Stars

34 stars

Watchers

4 watching

Forks

8 forks
Report repository

Sponsor this project

 
Learn more about GitHub Sponsors

Languages