Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with gsutil download_model.sh #1

Closed
unrealwill opened this issue Feb 14, 2019 · 11 comments
Closed

Issue with gsutil download_model.sh #1

unrealwill opened this issue Feb 14, 2019 · 11 comments

Comments

@unrealwill
Copy link

Hi,

I'm not familiar with gsutil. Installed it freshly using the 6 steps of :
https://cloud.google.com/storage/docs/gsutil_install

Upon running the script :

When I'm not logged in on cloud.

ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//checkpoint.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//encoder.json.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//hparams.json.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.data-00000-of-00001.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.index.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.meta.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//vocab.bpe.

When I'm logged in on cloud :


AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.
AccessDeniedException: 403 myemail@gmail.com does not have storage.objects.list access to gpt-2.

Thanks

@unrealwill
Copy link
Author

My mistake, didn't understood that 117M was the name of the model. I was executing download_model.sh without arguments

@maraoz
Copy link

maraoz commented Feb 14, 2019

Had the same problem 🙃

@loretoparisi
Copy link

loretoparisi commented Feb 14, 2019

gosh!!!! I though it was the size of the file or the numbers of parameters of the model 🤣

May I suggest to using google drive to store the model as a zip? I had to install the whole google-cloud-sdk stuff to download the model 🙈

@unrealwill unrealwill reopened this Feb 14, 2019
@unrealwill
Copy link
Author

I reopen it, as it seems some other people encounter the issue too.

@jainaayush05
Copy link

Haha, even I fell for it... Can't believe so many people did!!

@WuTheFWasThat
Copy link
Collaborator

sorry folks, read the README :)

will consider a more streamlined download process in the future! if someone can get rid of the gsutil dependency, i'd be happy to accept that PR!

@jamesyu
Copy link

jamesyu commented Feb 15, 2019

I was stuck on this as well. Definitely thought it was the filesize.

@HomeLH
Copy link

HomeLH commented Feb 15, 2019

sh download_model.sh 117M
117M is a parameter.

@loretoparisi
Copy link

I have removed the gsutil dependency in this PR

@unrealwill
Copy link
Author

People keep falling into the trap :)
#13
#23

@WuTheFWasThat Maybe we can help their them improve their natural language understanding skill a little by adding some thing like :

if [ "$#" -ne 1 ]; then
    echo "You must enter the model name as a parameter : sh download_model.sh 117M"
    exit 1
fi

At the top of the download_model.sh file

Thanks.

@WuTheFWasThat
Copy link
Collaborator

@unrealwill added, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants