PR #59616: ReLU Epilogue Fusion for FP8 GEMMs in XLA #1454
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR #59616: ReLU Epilogue Fusion for FP8 GEMMs in XLA
Imported from GitHub PR tensorflow/tensorflow#59616
Enables the epilogue fusion of ReLU activations for FP8 GEMMs.
Copybara import of the project:
--
8813bb2940dd4e5d53bb4092c1a1ee2a2f00a13b by Philipp Hack phack@nvidia.com:
Epilogue fusion of ReLU activations for FP8 GEMMs.
--
c9ee1d5869eaafa7e89842e9a460b96c9b912481 by Philipp Hack phack@nvidia.com:
Epilogue fusion of ReLU activations for FP8 GEMMs.
Merging this change closes #59616
FUTURE_COPYBARA_INTEGRATE_REVIEW=tensorflow/tensorflow#59616 from philipphack:u_fp8_relu_xla c9ee1d5869eaafa7e89842e9a460b96c9b912481