[quant][graphmode] Add quantized conv2d-relu fusion pattern

[jerryzh168]

Stack from ghstack:

• [not4land] debugging #33650 [not4land] debugging
• [not4land] Temporary workaround to get quantized ops #33533 [not4land] Temporary workaround to get quantized ops
• [quant][graphmode] quantization support for aten::add #34572 [quant][graphmode] quantization support for aten::add
• [quant][graphmode] quantization work for prim::If #34518 [quant][graphmode] quantization work for prim::If
• [quant][graphmode][fix] use observed_values_ to check values are observed #34571 [quant][graphmode][fix] use observed_values_ to check values are observed
• [quant][graphmode][refactor] insertObservers for Block #34414 [quant][graphmode][refactor] insertObservers for Block
• [quant][graphmode][fix] Insert dequantize before use node #34411 [quant][graphmode][fix] Insert dequantize before use node
• [quant][graphmode][fix] preserve the type of original value when inserting dequant node #34349 [quant][graphmode][fix] preserve the type of original value when inserting dequant node
• [quant] Add dequantize.tensors #34348 [quant] Add dequantize.tensors
• [quant][graphmode] Add quantization support for aten::dropout #34347 [quant][graphmode] Add quantization support for aten::dropout
• [quant][graphmode] Add quantization support for aten::cat #34346 [quant][graphmode] Add quantization support for aten::cat
• [quant][graphmode] Add prim::ListConstruct to general op handling #34345 [quant][graphmode] Add prim::ListConstruct to general op handling
• [quant][graphmode] insert quant/dequant work for duplicated debugName #34315 [quant][graphmode] insert quant/dequant work for duplicated debugName
• [quant][graphmode][refactor] Change QParamMap to QParamVector #34314 [quant][graphmode][refactor] Change QParamMap to QParamVector
• [quant][graphmode] Quantization pattern for aten::linear #33854 [quant][graphmode] Quantization pattern for aten::linear
• [quant][graphmode] Add quantization pattern for quantized::add_relu #33532 [quant][graphmode] Add quantization pattern for quantized::add_relu
• [quant][graphmode] Add quantized conv2d-relu fusion pattern #33279 [quant][graphmode] Add quantized conv2d-relu fusion pattern
• [quant][graphmode] Add Finalize function that inlines graph and produce quantized ops #33927 [quant][graphmode] Add Finalize function that inlines graph and produce quantized ops

Summary:
att

Test Plan:
python test/test_jit.py

Reviewers:
mvz

Subscribers:

Tasks:

Tags:

Differential Revision: D20354878

[dr-ci]

💊 CircleCI build failures summary and remediations

As of commit 48f6a27 (more details on the Dr. CI page):

---

• 1/1 failures introduced in this PR

---

🕵️ 1 new failure recognized by patterns

The following build failures do not appear to be due to upstream breakages:

pytorch_macos_10_13_py3_test (1/1)

Step: "Test" (full log | pattern match details)

Mar 12 11:13:24 RuntimeError: test_jit failed!

Mar 12 11:13:23 Ran 2429 tests in 134.029s 
Mar 12 11:13:23  
Mar 12 11:13:23 FAILED (errors=1, skipped=70, expected failures=1) 
Mar 12 11:13:23  
Mar 12 11:13:23 Generating XML reports... 
Mar 12 11:13:24 Traceback (most recent call last): 
Mar 12 11:13:24   File "test/run_test.py", line 674, in <module> 
Mar 12 11:13:24     main() 
Mar 12 11:13:24   File "test/run_test.py", line 667, in main 
Mar 12 11:13:24     raise RuntimeError(message) 
Mar 12 11:13:24 RuntimeError: test_jit failed! 
Mar 12 11:13:24 + cleanup 
Mar 12 11:13:24 + retcode=1 
Mar 12 11:13:24 + set +x 

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker.

This comment has been revised 206 times.

[raghuramank100]

Are there other checks that one can do: i.e check if there is a single inlined graph and that all weight tensors are constants?

[jerryzh168]

you mean the functionality of freeze? doesn't feel like that's something we should be testing here

[facebook-github-bot]

This pull request has been merged in 0ff4d37.