graph mode: refactor quantized hardswish API for easier graph handling

[vkuzo]

Stack from ghstack:

• graph mode: add handling for layer_norm op #37525 graph mode: add handling for layer_norm op
• graph mode: add hardswish op #37524 graph mode: add hardswish op
• graph mode: refactor quantized hardswish API for easier graph handling #37523 graph mode: refactor quantized hardswish API for easier graph handling
• graph mode: add hardsigmoid op #37522 graph mode: add hardsigmoid op
• graph mode: add elu op #37521 graph mode: add elu op
• graph mode: add hardtanh op #37469 graph mode: add hardtanh op

Summary:

Makes the quantized hardswish function API more suited to graph mode
handling, which will come in the next PR.

Test Plan: CI

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D21310364

[dr-ci]

💊 Build failures summary and remediations

As of commit 64699b9 (more details on the Dr. CI page):

---

• 1/2 failures possibly* introduced in this PR
  • 1/1 non-CircleCI failure(s)
• 1/2 tentatively recognized as flaky ❄️
  • Click here to rerun these jobs

---

❄️ 1 tentatively flaky failure

1 failure tentatively classified as flaky but reruns have not yet been triggered to confirm:

pytorch_bazel_test (1/1)

Step: "Test" (full log | pattern match details | 🔁 rerun) ❄️

Apr 29 20:54:07 TIMEOUT: //:optim_test (Summary)

Apr 29 20:53:53 [       OK ] AnyValueTest.TypeInfoIsCorrectForStringLiteral (0 ms) 
Apr 29 20:53:53 [ RUN      ] AnyValueTest.TypeInfoIsCorrectForString 
Apr 29 20:53:53 [       OK ] AnyValueTest.TypeInfoIsCorrectForString (0 ms) 
Apr 29 20:53:53 [----------] 12 tests from AnyValueTest (1 ms total) 
Apr 29 20:53:53  
Apr 29 20:53:53 [----------] Global test environment tear-down 
Apr 29 20:53:53 [==========] 30 tests from 2 test suites ran. (3 ms total) 
Apr 29 20:53:53 [  PASSED  ] 30 tests. 
Apr 29 20:53:53 ================================================================================ 
Apr 29 20:54:07  
Apr 29 20:54:07 TIMEOUT: //:optim_test (Summary) 
Apr 29 20:54:07       /var/lib/jenkins/.cache/bazel/_bazel_jenkins/fdf6d09bf4b4f04a71e2a7dfceb40620/execroot/pytorch/bazel-out/k8-fastbuild/testlogs/optim_test/test.log 
Apr 29 20:54:07 INFO: From Testing //:optim_test: 
Apr 29 20:54:07 ==================== Test output for //:optim_test: 
Apr 29 20:54:07 Running main() from gmock_main.cc 
Apr 29 20:54:07 Note: Google Test filter = -*_CUDA 
Apr 29 20:54:07 [==========] Running 28 tests from 1 test suite. 
Apr 29 20:54:07 [----------] Global test environment set-up. 
Apr 29 20:54:07 [----------] 28 tests from OptimTest 
Apr 29 20:54:07 [ RUN      ] OptimTest.OptimizerAccessors 
Apr 29 20:54:07 [       OK ] OptimTest.OptimizerAccessors (2 ms) 

---

ci.pytorch.org: 1 failed

• Failed: pr/py3.6-clang7-rocmdeb-ubuntu16.04

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker.

See how this bot performed.

This comment has been revised 2 times.

[jerryzh168]

Thanks!

[facebook-github-bot]

This pull request has been merged in 7ac98c9.