null-dev / llmcode-server Public

Notifications You must be signed in to change notification settings
Fork 1
Star 5

LLM server that provides an optimized version of the WizardCoder model as an API endpoint

5 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
docker		docker
src		src
.dockerignore		.dockerignore
.gitignore		.gitignore
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
README.md		README.md
dl.sh		dl.sh
docker-compose.yml		docker-compose.yml

Repository files navigation

llmcode-server

llmcode-server provides an API endpoint for using the WizardCoder-15B model.

Features:

Optimized for fast responses
- Uses CTranslate2 and https://huggingface.co/michaelfeil/ct2fast-WizardCoder-15B-V1.0
Designed for: https://github.com/videogameaholic/starcoder-intellij

About

LLM server that provides an optimized version of the WizardCoder model as an API endpoint

Report repository

Releases

No releases published

Packages

No packages published

Languages