-
Notifications
You must be signed in to change notification settings - Fork 214
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
A question about the x dimension. #26
Comments
Hi @tianjunyu0871 , It should be solvable using different command line arguments Is it helpful? |
Yes this is an error We use the evaluation code as used in the OSCAR repository We already shared the weights of MLP - see "Inference Notebooks" section in the readme. |
Prediction with transformer is available in this notebook |
I have gained a lot from your work, but I still have a few questions, and I hope to get your answers. |
To generate more than one sentence you should replace the inference algorithm (e.g. beam search) We haven't tried to use different GPT models. prefix_length_clip control the transformer mapping network - size (in tokens) of the clip embedding, as some of the prefix is a learned const. |
When I train only transformer mapping network,I found that the dimension of x is(40 , 512),but prefix_dim = 640.I don't know why this is happening. Is it caused by the extraction of clip features? Hope to get your help, thank you.
![image](https://user-images.githubusercontent.com/55222964/153883683-be805784-803e-4190-b64a-89d4985ee840.png)
The text was updated successfully, but these errors were encountered: