Skip to content

Commit

Permalink
Updating FusedSiLU activation test to conform with updated nvFuser ke…
Browse files Browse the repository at this point in the history
…rnel generation (#104)

* Updating test to new nvfuser kernel generation

* Updating CHANGELOG
  • Loading branch information
akshaysubr committed Jan 21, 2024
1 parent d831eab commit 0a49aa8
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Fixed

- Fix bug for `ConvFullyConnectedArch`.
- Updating `Activation.SILU` test to conform with updated nvFuser kernel generation.

## [1.3.0] - 2023-11-20

Expand Down
2 changes: 1 addition & 1 deletion test/test_models/test_activation.py
Original file line number Diff line number Diff line change
Expand Up @@ -143,7 +143,7 @@ def cleanup_events(event_keys):
print("silu_scripted_3rd num_events: ", num_kernels)
if version.parse(torch.__version__) >= version.parse("1.12.9"):
# fwd + 1st_deriv + 2nd_deriv + 3rd_deriv kernels
assert num_kernels <= 6
assert num_kernels <= 7
else:
warnings.warn(f"Fused SiLU is not supported for torch {torch.__version__}")

Expand Down

0 comments on commit 0a49aa8

Please sign in to comment.