[QNNPACK:Sparsity] Add A matrix pretransformed based sparse kernels for FC

[kimishpatel]

Stack from ghstack:

• [QNNPACK Sparsity] Add aarch64 kernel of 8x1 sparsity #51120 [QNNPACK Sparsity] Add aarch64 kernel of 8x1 sparsity
• [QNNPACK, Sparsity] Add 8x1 block sparse kernels for aarch32. #51119 [QNNPACK, Sparsity] Add 8x1 block sparse kernels for aarch32.
• [QNNPACK, Sparsity] Code refactoring to allow for more generic block #51118 [QNNPACK, Sparsity] Code refactoring to allow for more generic block
• [QNNPACK, Sparsity] Add dyanmic linear sparse kernel for arm64 #50591 [QNNPACK, Sparsity] Add dyanmic linear sparse kernel for arm64
• [QNNPACK, Sparsity] Sparse kernel with 4x8 blocking #50590 [QNNPACK, Sparsity] Sparse kernel with 4x8 blocking
• [QNNPACK, Sparsity] Added prepacking base aarch32 kernels #50589 [QNNPACK, Sparsity] Added prepacking base aarch32 kernels
• [QNNPACK, Sparsity] ARMV7, aarch32, kernels for dynamic linear #50588 [QNNPACK, Sparsity] ARMV7, aarch32, kernels for dynamic linear
• [QNNPACK:Sparsity] Add A matrix pretransformed based sparse kernels for FC #50587 [QNNPACK:Sparsity] Add A matrix pretransformed based sparse kernels for FC
• [QNNPACK Sparse] Create fc sparse operator #50586 [QNNPACK Sparse] Create fc sparse operator
• [QNNPACK] Block Sparse kernel. First commit. #50585 [QNNPACK] Block Sparse kernel. First commit.

Summary:
This diff introduces two kernesl. One is to pretransform A to do block
wise transforms.
And then the kernel that directly works on top pretransformed weights.

Test Plan:
./build/local/q8gemm-sparse-test
./build/local/fully-connected-sparse-test

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D25925504

[axitkhurana]

typo: uint8_t

[facebook-github-bot]

This pull request has been merged in 7360ce3.