-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Pass encoding dimensions to SequenceCombiner #3321
Conversation
If this argument isn't passed along then the `attention` reducer doesn't work for me. Note that although this fixes it for me I suspect there's lots of other places this would have to be applied. But maybe someone more experienced could chip in with if this is indeed an acceptable solution and other things to consider?
Unit Test Results 4 files ± 0 4 suites ±0 41m 42s ⏱️ + 12m 59s Results for commit cc7b02b. ± Comparison against base commit e49eae9. This pull request skips 3 tests.
♻️ This comment has been updated with latest results. |
Hi @RXminuS, The change looks reasonable to me! We'd probably want to make the same change to all of the encoders in text_encoders that have reducers, but doing this for the Auto encoder first makes sense. Not totally sure why all of the tests are failing in your PR though. I'll re-run the CI. |
Cool, happy to expand the PR to the others once tests pass 👍 thanks for reviewing |
Thanks for the contribution @RXminuS! Most of these test failures look like issues with some recently added tests that use S3. So the fix on our side will simply be to exclude those tests when running from a fork. cc @abidwael The only one I'm not sure on is |
@tgaddair thanks for the pointers. I've removed this test |
I've also gone ahead and applied the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thanks for the contribution :)
We should do a follow-up to address other occurrences of this issue.
Thanks for the contribution Rik! |
If this argument isn't passed along then the
attention
reducer doesn't work for me.Note that although this fixes it for me I suspect there's lots of other places this would have to be applied. But maybe someone more experienced could chip in with if this is indeed an acceptable solution and other things to consider?