-
Notifications
You must be signed in to change notification settings - Fork 463
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add variable batch per feature support to EBC (tw/cw only) #1986
Conversation
✅ Deploy Preview for pytorch-fbgemm-docs canceled.
|
This pull request was exported from Phabricator. Differential Revision: D48805440 |
) Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and reverse_indices to the KJT Reindexing is done internally with EBC and with a user provided reverse indices tensor Differential Revision: D48805440 fbshipit-source-id: 3f9439b0ca5325489fcf9c629bffe95da53ece9c
This pull request was exported from Phabricator. Differential Revision: D48805440 |
) Summary: X-link: pytorch/torchrec#1358 Pull Request resolved: pytorch#1986 To enable provide stride_per_key_per_rank and reverse_indices to the KJT Reindexing is done internally with EBC and with a user provided reverse indices tensor Differential Revision: D48805440 fbshipit-source-id: 504f1dd0ebe0c2de28fe4d2bc623e3ba3b4da69a
fbaa36f
to
108d23e
Compare
) Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and reverse_indices to the KJT Reindexing is done internally with EBC and with a user provided reverse indices tensor Differential Revision: D48805440 fbshipit-source-id: 2cb3665209025a44e659e5277534ad3f9e41ae0d
This pull request was exported from Phabricator. Differential Revision: D48805440 |
) Summary: X-link: pytorch/torchrec#1358 Pull Request resolved: pytorch#1986 To enable provide stride_per_key_per_rank and reverse_indices to the KJT Reindexing is done internally with EBC and with a user provided reverse indices tensor Differential Revision: D48805440 fbshipit-source-id: ded203e36f575e3ffb8a5b04591a1891bdccc1bc
108d23e
to
4c9fdb4
Compare
) Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and reverse_indices to the KJT Reindexing is done internally with EBC and with a user provided reverse indices tensor Differential Revision: D48805440 fbshipit-source-id: b151328e3d2e8ec6cae4f235db505d9a3a70e3fd
This pull request was exported from Phabricator. Differential Revision: D48805440 |
) Summary: X-link: pytorch/torchrec#1358 Pull Request resolved: pytorch#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with a user provided inverse indices tensor we provide a utility function `merge_inverse_indices_per_key` to convert inverse indices in format `Dict[str, torch.Tensor]` to `torch.Tensor` accepted by KJT constructor Differential Revision: D48805440 fbshipit-source-id: cf889a87ab0f516897a7476268f321a97db079b5
4c9fdb4
to
ac098ad
Compare
) Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with a user provided inverse indices tensor we provide a utility function `merge_inverse_indices_per_key` to convert inverse indices in format `Dict[str, torch.Tensor]` to `torch.Tensor` accepted by KJT constructor Differential Revision: D48805440 fbshipit-source-id: f66d4ec17457780922d8d63a8b71d45bd272c535
) Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with a user provided inverse indices tensor we provide a utility function `merge_inverse_indices_per_key` to convert inverse indices in format `Dict[str, torch.Tensor]` to `torch.Tensor` accepted by KJT constructor Differential Revision: D48805440
) Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with a user provided inverse indices tensor we provide a utility function `merge_inverse_indices_per_key` to convert inverse indices in format `Dict[str, torch.Tensor]` to `torch.Tensor` accepted by KJT constructor Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
ac098ad
to
6f0abb0
Compare
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Differential Revision: D48805440
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
) Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with a user provided inverse indices tensor we provide a utility function `merge_inverse_indices_per_key` to convert inverse indices in format `Dict[str, torch.Tensor]` to `torch.Tensor` accepted by KJT constructor Differential Revision: https://internalfb.com/D48805440 fbshipit-source-id: ae10bfae756a278c80be01f803176280215eb809
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Differential Revision: D48805440
Summary: Pull Request resolved: pytorch#1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Differential Revision: https://internalfb.com/D48805440 fbshipit-source-id: 227aa80bc7aca187e96c131305cc185790df0ee8
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
1 similar comment
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
1 similar comment
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
Summary: X-link: pytorch/torchrec#1358 Pull Request resolved: pytorch#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440 fbshipit-source-id: 9f49f7789ea2a20344cc56f84018fc761892836d
Summary: X-link: pytorch/torchrec#1358 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440
This pull request was exported from Phabricator. Differential Revision: D48805440 |
This pull request has been merged in 54340d4. |
Summary: Pull Request resolved: #1358 X-link: pytorch/FBGEMM#1986 To enable provide stride_per_key_per_rank and inverse_indices to the KJT Reindexing is done internally with EBC and with user provided inverse indices Reviewed By: bigning Differential Revision: D48805440 fbshipit-source-id: e490baa41b9c91b02e6c246940d4a3a2c4551d65
Summary:
To enable provide stride_per_key_per_rank and reverse_indices to the KJT
Reindexing is done internally with EBC and with a user provided reverse indices tensor
Differential Revision: D48805440