Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pls clarify nature of colab ban #39

Open
samrahimi opened this issue Mar 28, 2023 · 1 comment
Open

Pls clarify nature of colab ban #39

samrahimi opened this issue Mar 28, 2023 · 1 comment

Comments

@samrahimi
Copy link

2 questions (brilliant work btw!)

  1. is there an automated process preventing the use of this model on colab? if so, what's being blocked... i saw your notes from an earlier commit.
  2. WHY are they blocking it? it this model ONLY good for nsfw? or is that just one of its uses?
  3. Can this run on CPU? What about on an iPad pro, its not an M series but its a decent one just a few years old
@0x000011b
Copy link
Collaborator

Hello! Basically:

  1. As for what's being blocked: Google detects any instances of /PygmalionAI/ inside the notebook's cells and automatically warns that your account may be banned if you decide to run the code, so we've removed the easy Colab notebook for now to prevent anyone from being unfairly banned. There are obviously workarounds for this, but we'd rather respect Google's wishes. It's their service after all.
  2. Your guess is as good as mine. The ban was done without any explanation from Google's end, and when we reached out for clarification the response we got was basically "sorry, we don't offer any sort of support for Colab". The model can do SFW just fine, and there's plenty of other NSFW Colabs out there (e.g. for Stable Diffusion), so I think it's pretty unlikely that this is the reason.
  3. It should. ggml allows running quantized LMs on CPU at reasonable speeds (see: llama.cpp), it'd just be a matter of implementing the relevant backing model architecture (GPT-J for 6B, NeoX for 1.3B/2.7B, OPT for 350M as of now) and having some sort of UI to interact with the model. This is outside the scope of the project though, so unfortunately I don't have any pointers for that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants