Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLI does not work with Bun #146

Closed
3 tasks
drschwabe opened this issue Jan 22, 2024 · 1 comment
Closed
3 tasks

CLI does not work with Bun #146

drschwabe opened this issue Jan 22, 2024 · 1 comment
Labels
bug Something isn't working invalid This doesn't seem right

Comments

@drschwabe
Copy link

Issue description

CLI does not work with Bun

Expected Behavior

bunx --no node-llama-cpp chat --model ./models/llama-2-7b.Q4_K_M.gguf

model should load correctly and enter a chat

Actual Behavior

bunx --no node-llama-cpp chat --model ./models/llama-2-7b.Q4_K_M.gguf

Returns: Not enough non-option arguments: got 0, need at least 1

Steps to reproduce

bun install node-llama-cpp
bunx --no node-llama-cpp chat --model ./models/llama-2-7b.Q4_K_M.gguf

My Environment

Ubuntu 22 |
"node-llama-cpp": "^2.8.5",

Additional Context

It would be great if this module works with bun

bun is super fast and let's us also use commonjs modules in the same script alongside esm import-only modules like node-llama-cpp

Relevant Features Used

  • Metal support
  • CUDA support
  • Grammar

Are you willing to resolve this issue by submitting a Pull Request?

Yes, I have the time, and I know how to start.

@drschwabe drschwabe added bug Something isn't working requires triage Requires triaging labels Jan 22, 2024
@giladgd
Copy link
Contributor

giladgd commented Jan 24, 2024

@drschwabe node-llama-cpp CLI works with Bun.
bunx doesn't support the --no parameter, so you should omit it when using bunx.

You should use the CLI like this:

bunx --bun node-llama-cpp chat --model ./models/llama-2-7b.Q4_K_M.gguf

@giladgd giladgd closed this as completed Jan 24, 2024
@giladgd giladgd added invalid This doesn't seem right and removed requires triage Requires triaging labels Jan 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants