Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues running local model on Linux #41

Closed
5oclockshadow opened this issue Mar 1, 2024 · 2 comments
Closed

Issues running local model on Linux #41

5oclockshadow opened this issue Mar 1, 2024 · 2 comments

Comments

@5oclockshadow
Copy link

Running it on kali linux and im having an issue utilizing the local model. the check box is tick on but when i click install nothing happens... it would be nice to have an acknowledgment or a progress bar...

@satellitecomponent
Copy link
Owner

It appears there are currently issues with the webLLM implementation when using the neurite.network host.

I will look into that, for now, you should be able to get it working from a cloned version of the repo.

The next update should allow for any ai backend to be used more easily than before, so being limited to webLLM should not be an issue very soon.

If you are using the neurite.network host, you should at least see a red x when trying to install the local ai. (I will look into getting it to work on the github pages host again as well, potentially relates to the new domain name?)

Otherwise,, when running Neurite locally with the right build setup as given in the readme, you should see the below circular loading icon that slowly fills up as the parameters install.

Screenshot 2024-03-08 140926

I am not using Linux, but it could be useful to see if you have any error logs, or what your environment is/ what browser you used.

@satellitecomponent
Copy link
Owner

I have decided to remove webLLM in favor of Ollama. The next update will reflect that change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants