Skip to content

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

License

Notifications You must be signed in to change notification settings

Shopgra702e/node-llama-cpp

Error
Looks like something went wrong!

About

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 90.5%
  • C++ 4.5%
  • CSS 1.9%
  • Vue 1.1%
  • JavaScript 0.9%
  • CMake 0.8%
  • Other 0.3%