Skip to content

cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.

License

Notifications You must be signed in to change notification settings

menloresearch/cortex.llamacpp

Error
Looks like something went wrong!

About

cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 7