Model cannot be downloaded because "Too many users have viewed or downloaded this file recently"

[0xRETR0]

For some reason i can still download it directly onto my PC, but the colab outputs an error.

[acheong08]

It seems that too many users are trying to use the colab. Currently looking into a solution to Google's rate limits

[acheong08]

A possible workaround if you have good internet is to download the file manually and upload it into your own Google Drive under /AI_models/novelai.zip

[acheong08]

The Colab will detect that and load it from your own drive

[memehammad]

You could also just copy the file to your own drive so you don't have to download then upload it.

[0xRETR0]

I'm aware that i can download it manually and upload it onto my drive, but my internet's way to slow for that. I've managed to work around it by changing the code up a bit and downloading the model from another one of my drives, long story short I couldn't use the google account I've used before, so I shared it model from there and used it on the other account. I'm more concerned for other people who don't have the model anywhere, that's why i made the issue

[acheong08]

You could also just copy the file to your own drive so you don't have to download then upload it.

Ah yes. I don't use drive much so I was unaware

[acheong08]

I'm aware that i can download it manually and upload it onto my drive, but my internet's way to slow for that. I've managed to work around it by changing the code up a bit and downloading the model from another one of my drives, long story short I couldn't use the google account I've used before, so I shared it model from there and used it on the other account. I'm more concerned for other people who don't have the model anywhere, that's why i made the issue

Perhaps we can compile a list of shared drive links to alternate between if one isn't working. I have no budget to host the model myself.

[acheong08]

I am temporairly resolving this by using a copy in another account

[0xRETR0]

Perhaps we can compile a list of shared drive links to alternate between if one isn't working. I have no budget to host the model myself.

Yeah, we could make some dummy accounts to host the model on. As i said earlier, my internet is way to slow to upload larger files anywhere, but one could probably exploit the script in the colab the same way as i did to get it onto the drives at high speeds. Alternatively, there are some free hosting services which also ignore DMCA's, but i have little to no idea on how does the code work, so i have no clue if its possible to work with non-google hosting

[acheong08]

Alternatively, there are some free hosting services which also ignore DMCA's

The issue is that the file is too large to upload onto those services

so i have no clue if its possible to work with non-google hosting

I have tried hosting the model on my own server with 1TB transfer limit. However, it was hit by a DDOS attack and now disabled (Payment wasn't connected or else I would've went bankrupt). The speeds are extremely slow outside Google or GitHub (10MB/s).

[acheong08]

It seems my student account has a Gsuite subscription provided by the school. That should increase the transfer limits by quite a lot. It's an old account and has no limits on storage.

[0xRETR0]

Alternatively, there are some free hosting services which also ignore DMCA's

The issue is that the file is too large to upload onto those services

so i have no clue if its possible to work with non-google hosting

I have tried hosting the model on my own server with 1TB transfer limit. However, it was hit by a DDOS attack and now disabled (Payment wasn't connected or else I would've went bankrupt). The speeds are extremely slow outside Google or GitHub (10MB/s).

I guess that's a lost cause then.

It seems my student account has a Gsuite subscription provided by the school. That should increase the transfer limits by quite a lot. It's an old account and has no limits on storage.

That's nice, hopefully it will be sufficient. If not, then dummy gdrive accounts are the only good option i can think of, if it will be needed I can make some. It's a good thing google doesn't go after dummies.

[acheong08]

I will reopen this if the error occurs again

[acheong08]

It seems gsuite is also limited

[acheong08]

The daily users has reached over ~500 which is way beyond the transfer limits

[acheong08]

Does anyone know of a reliable hosting service? I'm thinking IPFS but web3 isn't something I'm familiar with

[0xRETR0]

Does anyone know of a reliable hosting service? I'm thinking IPFS but web3 isn't something I'm familiar with

What about dummy GDrive accounts? It might be pretty tedious for the user to switch them around and look for one that's working, but according to some research the download limit per file is 2TB a day, so with the current amount of users being over 500 just a couple accounts would be sufficient.

[acheong08]

Well, it seems 500 was exceeded. I've been alternating between 5 accounts manually and all of them have been limited. Currently looking into hiding it in a huggingface repo

[acheong08]

Damn. The bandwidth is now running out minutes after update

[0xRETR0]

Well, it seems 500 was exceeded. I've been alternating between 5 accounts manually and all of them have been limited. Currently looking into hiding it in a huggingface repo

A huggingface repo would probably make sense

Damn. The bandwidth is now running out minutes after update

Oh lord, that's quick. You could try mega.nz, from what i know it doesn't limit the files directly, but the person downloading. The colab would probably be counted as a single user, but perhaps it could be worked around by requiring the user to log into their Mega account, if that's even possible?

[acheong08]

I have uploaded it onto huggingface. I'm not sure how long it'll take them to notice that it's pirated since it's zipped