LagPixelLOL / cog-exllama Public

Notifications You must be signed in to change notification settings
Fork 4
Star 8

Inference using exllama with cog.

8 stars 4 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
loras		loras
models		models
.dockerignore		.dockerignore
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
cog.yaml		cog.yaml
download-model.py		download-model.py
predict.py		predict.py

Repository files navigation

cog-exllama

Inference using exllama with cog.

About

Inference using exllama with cog.

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%