-
Notifications
You must be signed in to change notification settings - Fork 736
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Chrome demo frequently terminates while loading #322
Comments
I am experiencing the same problem. So far, I understood the problem starts once it tries to pull the models from the cache. |
Apologies for the inconvenience, I'll look into this issue today. Meanwhile, clearing chrome's cache might alleviate the problem. |
@neubig @kudaibergenu Just updated the npm to 0.2.24: #323 This should fix it. Let us know if issues persist. Thank you! |
Thanks for the fast response @CharlieFRuan ! |
I'm still experiencing this issue even after updating to the latest version (0.2.24). Would you be open to further investigation? Some notes from my own experience:
Happy to help chase this down - thanks! |
Hi @mrsheep76 what is the error that you are seeing? Is it also |
Hi @CharlieFRuan - yes, same error as described at the top of this bug - And here is the UI after it crashed: Let me know if there's anything else I can do to gather information - and thanks for investigating! |
And actually I'm still encountering crashes as well, although it seems less frequent than before. |
@mrsheep76 @neubig Thanks for the info, I'll look into it today! |
@mrsheep76 @neubig I was not able to replicate the error (either via simple chat or the chrome extension example). But I published 0.2.25, with the hope of fixing this (assuming the issue is due to parallelly downloading too many shards at the same time). For more description, see #328. Let me know, thanks! |
@CharlieFRuan Thanks for the attempted fix! Unfortunately I'm still getting crashes 90%+ of the time when loading from cache -- same frequency as before from what I can tell. It does occasionally work, so I wonder if there's a race condition somewhere? Is there any way for me to get a more informative error message and pass it to you, since you cannot reproduce it yourself? The |
Hmm I see; before we further dig into this, could you perhaps try a smaller model, say Gemma 2B (assuming that you are using Mistral 7B q4f16, the default one in the chrome extension example). Not sure how much RAM you have, but it could be that the model is too large? See discussion in #324 for specifics. |
Another minor follow-up to version 0.2.24 (or hence to 0.2.25). This PR adds a `try-catch` when loading the **_already-downloaded_** weights, attempting to provide more information to the `exit(1)` error in #322. The only change is TVMJS's commit apache/tvm@b193cbb from apache/tvm#16650
I also further bumped to 0.2.26, which adds an additional try-catch, attempting to provide more information to the |
Thanks! I tried 4-5 times now, including after clearing cache and every time worked! So maybe this is fixed with the new version. Closing for now, thanks @CharlieFRuan ! |
@neubig Thanks for confirming; feel free to reopen any time! |
Good news - it is now working for me as well! I had a temporary glitch with my build environment during my last test run, so I suspect one of the earlier fixes actually did the trick (perhaps limiting the number of concurrent threads)? In any case, it is working consistently now. Thank you for all the help! |
@mrsheep76 Thanks, that is great to hear! Feel free to open new issues if there are other problems |
Thank you for the great project! I'm playing with the chrome extension. It works some of the time, but it also frequently (>50% of the time) dies while loading the model. The progress bar stops half-way through, and this is what I see in the console when I inspect the plugin popup:
I'm using:
I'm happy to help debug in any way.
The text was updated successfully, but these errors were encountered: