Beginner question about the models #15
Comments
Hello, how did you get this awesome error message and what you're trying to achieve? |
I'm trying to generate text based on a prompt input.
And then sample a sequence. |
I didn't use the default tokeniser, but you're using the default code with default tokeniser and the error is because of that. To understand how to generate text you should start by looking at rest.py. |
Thank you for this. I had a look. However, this way it is too heavy from a computational point of view. I am trying to run it on an EC2 instance in a reasonable amount of time so I can serve it as an API call. Any suggestions ? |
Have you tried to run it on a GPU instance? Apache 2.0 |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Hello and thank you for the great work.
This might be a rather stupid question, but I'm just beginning with NPL. Apologies in advance.
Could you give me a brief intro with regards to the files generated in the models ?
I am asking this because when I try to load the head model class and the tokenizer class I get the following error:
We assumed '../russian_models/gpt2/m_checkpoint-3364613' was a path or url to a directory containing vocabulary files named ['vocab.json', 'merges.txt'] but couldn't find such vocabulary files at this path or url
Of course, those files are not present there, but I'm not sure where to start at the moment.
And a second question if possible, are you licensing this project under MIT by any chance?
Thank you in advance.
The text was updated successfully, but these errors were encountered: