andreasjansson / llama-2-grammar Public

Notifications You must be signed in to change notification settings
Fork 3
Star 6

Cog wrapper for llama.cpp's grammar decoder

6 stars 3 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.gitignore		.gitignore
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
cog.yaml		cog.yaml
json_schema_to_grammar.py		json_schema_to_grammar.py
predict.py		predict.py

Repository files navigation

Llama 2 grammar

Llama 2 with grammar-based decoding (provided by llama.cpp).

About

Cog wrapper for llama.cpp's grammar decoder

Report repository

Releases

No releases published

Packages

No packages published

Languages