Skip to content

AminZarei72/llama.deno

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

tiny port to llama.cpp project with Deno ffi library(whcih let you connect to native languages and use their functions in javascript directly!)

Usage

#compiling:

deno task compileCLib
deno task compile
./server localhost 5000 ./models/model.ggml.bin ./llama.cpp.modified/liblama

#test it with:

 curl -X POST -H "Content-Type: application/json" -d '{"prompt": "  hello are you ready for our conversation ? "}' http://localhost:5000/

#developing:

deno task dev

Note: i'm going to stop developing this until guys at Deno project support Arm64 issue .

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published