We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
With genv 1.4.1 genv llm works for the multi-user use case. But genv remote llm doesn't seem to have picked up on the change:
genv llm
genv remote llm
$ genv remote -H <host> llm ps HOST MODEL PORT CREATED EID USER <host> llama2:7b/45893N/A 2 hours ago 2891 <user>
note how the model is reported as "llama2:7b/45893" with the port presumably being "N/A".
Correspondingly, the following happens:
$ genv remote -H <host> llm attach llama2:7b Could not find LLM model 'llama2:7b' $ genv remote -H <host> llm attach llama2:7b/45893 pulling manifest Error: pull model manifest: file does not exist
The text was updated successfully, but these errors were encountered:
hi @jangmarker thanks for this issue! I fixed it and released Genv 1.4.2.
pls let me know if this issue is not resolved.
thanks again!
Sorry, something went wrong.
It's fixed, thanks a lot!
No branches or pull requests
With genv 1.4.1
genv llm
works for the multi-user use case. Butgenv remote llm
doesn't seem to have picked up on the change:note how the model is reported as "llama2:7b/45893" with the port presumably being "N/A".
Correspondingly, the following happens:
The text was updated successfully, but these errors were encountered: