-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[VS Code] Connot reach the server #81
Comments
Could be something simple, for example the model might be still loading. We also have this issue: self-hosted config changes is slow to reach the plugins, smallcloudai/refact#158 |
...it's still bad that you hit it, and we want to know what happened, maybe we can convert it to something we can fix. |
I can be certain that the model is up and running because when I execute the following on the server:
It immediately returns:
This indicates that the request has been successfully processed, and the generated response contains the completion for the provided prompt. |
I think the issue might be related to the plugin. When I tried to locate the service occupying port 9098, I found a service named "refact-lsp." Could it be the problem with this service? |
Well it definitely works, based on your test! You can take a look at the logs:
And it can still be smallcloudai/refact#158 which we really need to fix. |
Thank you for your prompt reply! I tried the commands you provided, but it failed because there were no logs in the ~/.cache/refact/ directory. The result of executing
|
I also ran |
I apologize for my earlier mistake. After running the command locally, here are the results:
|
Looks alright! Should work if it can download the tokenizer etc. |
I seem to have found the reason. It's because the URL "https://huggingface.co//models/deepseek-coder-6.7b-instruct/resolve/main/tokenizer.json" doesn't exist. |
That's strange. The correct URL should be https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct/resolve/main/tokenizer.json. |
I've figured out the reason! It's because I previously used offline model downloads, and I modified the model_path in |
Thank you very much for your help!!! |
Thanks for trying stuff! |
The Self-hosted Refact and the model ran successfully. I also logged into refact-vscode. However, when I tried code completion, it failed with
Cannot reach the server. POST http://127.0.0.1:9098/v1/code-completion timed out after 20000 ms
.The text was updated successfully, but these errors were encountered: