python run_inference.py -m models/Llama3-8B-1.58-100B-tokens/ggml-model-i2_s.gguf -p "What anime is popular in Japan?\nAnswer:" -n 256 -temp 0.1
-
Notifications
You must be signed in to change notification settings - Fork 0
crosscore/bitnet.cpp-env
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published