Skip to content

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

License

Notifications You must be signed in to change notification settings

Tlryd/node-llama-cpp

Error
Looks like something went wrong!

About

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 88.4%
  • C++ 6.9%
  • CSS 3.3%
  • Other 1.4%