Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

genv remote llm fails to extract port number #61

Closed
jangmarker opened this issue May 6, 2024 · 2 comments
Closed

genv remote llm fails to extract port number #61

jangmarker opened this issue May 6, 2024 · 2 comments

Comments

@jangmarker
Copy link

With genv 1.4.1 genv llm works for the multi-user use case. But genv remote llm doesn't seem to have picked up on the change:

$ genv remote -H <host> llm ps
HOST             MODEL       PORT    CREATED              EID     USER
<host>           llama2:7b/45893N/A     2 hours ago          2891    <user>

note how the model is reported as "llama2:7b/45893" with the port presumably being "N/A".

Correspondingly, the following happens:

$ genv remote -H <host> llm attach llama2:7b
Could not find LLM model 'llama2:7b'
$ genv remote -H <host> llm attach llama2:7b/45893
pulling manifest
Error: pull model manifest: file does not exist
@razrotenberg
Copy link
Contributor

hi @jangmarker thanks for this issue!
I fixed it and released Genv 1.4.2.

pls let me know if this issue is not resolved.

thanks again!

@jangmarker
Copy link
Author

It's fixed, thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants