Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

matrix multiplication errors while training #3

Closed
jnistane3 opened this issue Apr 4, 2023 · 2 comments
Closed

matrix multiplication errors while training #3

jnistane3 opened this issue Apr 4, 2023 · 2 comments

Comments

@jnistane3
Copy link

Running into an issue of matrix multiplication while training the model, any ideas on how to solve this?
image

@rishigurnani
Copy link
Collaborator

Hi @jnistane3, it appears that you are training a single task model, right? For single task models, selector_dim should equal 0. selector_dim refers to the dimension of the selector vector. For multi-task data, prepare_train will, for each row in your data, create a selector vector. Each vector contains one dimension per task. For single task, prepare_train creates an empty selector vector, so the dimension is equal to 0. I will add comments to example.py and example2.py to clarify this. Try selector_dim = 0 and let me know how it goes.

@jnistane3
Copy link
Author

Perfect, setting selector_dim to zero solved it for my single-task models. Thanks @rishigurnani!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants