Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle transposes in second batch of matrices in bmm #451

Merged
merged 6 commits into from
Jun 14, 2023
Merged

Conversation

DenisVieriu97
Copy link
Collaborator

Handle transposes in second batch of matrices in bmm op.

Improves bmm op perf if second matrix is transposed (row by row matrix multiplication is much faster compared to row by column since all memory is contiguous / no strided accesses are performed).

@DenisVieriu97 DenisVieriu97 changed the base branch from acdc to master June 14, 2023 19:42
@DenisVieriu97 DenisVieriu97 added the ciflow/torchbench Run Torchbench label Jun 14, 2023
@pytorch-bot
Copy link

pytorch-bot bot commented Jun 14, 2023

Warning: Unknown label ciflow/torchbench.
Currently recognized labels are

  • ciflow/binaries
  • ciflow/binaries_conda
  • ciflow/binaries_libtorch
  • ciflow/binaries_wheel
  • ciflow/inductor
  • ciflow/inductor-perf-test-nightly
  • ciflow/mps
  • ciflow/nightly
  • ciflow/periodic
  • ciflow/trunk
  • ciflow/unstable

Please add the new label to .github/pytorch-probot.yml

@kulinseth kulinseth merged commit 3683c76 into master Jun 14, 2023
7 of 9 checks passed
@razarmehr razarmehr added the Upstreamed Change has been upstreamed to PyTorch master label Aug 8, 2023
jhavukainen pushed a commit that referenced this pull request Mar 13, 2024
* Add transpose in bmm

* Handle transposes in second batch of matrices in bmm

* Fix comment

* Fix formatting

* Fix build failure

* Fix test failures
jhavukainen pushed a commit that referenced this pull request Mar 13, 2024
* Add transpose in bmm

* Handle transposes in second batch of matrices in bmm

* Fix comment

* Fix formatting

* Fix build failure

* Fix test failures
jhavukainen pushed a commit that referenced this pull request Mar 15, 2024
* Add transpose in bmm

* Handle transposes in second batch of matrices in bmm

* Fix comment

* Fix formatting

* Fix build failure

* Fix test failures
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/torchbench Run Torchbench Upstreamed Change has been upstreamed to PyTorch master
Projects
None yet
3 participants