Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NNPA] AffineLoad and AffineStore from/to zTensor without zlow.stick and zlow.unstick #1983

Draft
wants to merge 58 commits into
base: main
Choose a base branch
from
Draft

[NNPA] AffineLoad and AffineStore from/to zTensor without zlow.stick and zlow.unstick #1983

wants to merge 58 commits into from

Conversation

tungld
Copy link
Collaborator

@tungld tungld commented Jan 31, 2023 •
edited

Explanation will come soon.

  • TODO
    • Replace affine.load (cpuMemRef) by affine.load(zMemRef) followed by zlow.dlf16_to_f32
    • Replace affine.store (cpuMemRef) by zlow.f32_to_dlf16 followed by affine.load(zMemRef)
    • Lowering zlow.dlf16_to_f32 and zlow.f32_to_dlf16 to LLVM
    • Rule to remove a pair of (zlow.dlf16_to_f32 and zlow.f32_to_dlf16)
    • LIT tests

@tungld
zlow: add type constraints
2239b27 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
initial test
c560b21 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Use the pointer version
555955e 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor
5d38fc6
@tungld
ONNXUnaryOp supports zTensor
fbd1ce1 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
ONNXBinaryVariadicOp supports zTensor
477b6fa 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Enable layout propagation
aa55856 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
BinaryOp of ztensor and normal tensor
b8d91ba 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
COndition on f32
592dcc1 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
minor change
2d215b6 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
update condition
68d8e6f 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix affine map for 1D
36221d5 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix affine map for 2ds
1ab9450 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
undo affinemap for 1d and 2ds, since it's not the solution
1721dff 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
do not support 1d and 2ds
f62f505 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
use malloc instead of alloca
73348db 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Reciprocal caused errors
b2658d1 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
No use pointers
1894455 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor
6ed5a59
@tungld
clang-format
087f740 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix OMShapeHelperOpInterface link issue
be9186f 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
no unstick in layout propagation
aad619d 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor
1159ece
@tungld
Use LLVM code instead of calling external funcs
696437a 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor
137ffa6
@tungld
clang-format
ca3602a 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix wrong instruction
d59b092 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Use a separate pass at zlow instead of layout-prop at zhigh
793e004 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
missing file
ebe7913 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
clean up
94fa3f8 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
clean up
f1169e6 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix linking
3002e2b 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
clean up
ebef21d 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Write a pattern on ZLowUnstickOp instead of AffineLoadOp
e8290f4 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Generate LLVM code for fp32_to_dlf16
bb8ba10 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Pattern to replace AffineStore
0ec2319 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix moving ops
56df83a 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Full LLVM code for dlf16 to f32
15672c8 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Correct result for dlf16-to-f32
50beddf 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
fix f32-to-dlf16
d2c133d 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
SIMD for dlf16 to f32
a45bc7a 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
update
e153430 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
simd
5a22e53 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Remove redundant code
a10f3c4 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
simd for f32 to dlf16
000780f 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
clang-format
db31c7e 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
rule to remove a pair of dlf16-f32
4886062 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
use 8 float16
3a82880 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
upperbound for memref size
089164e 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor-simd
cb9676b
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor-simd
f1707b9
@tungld
update to the new LLVM
805b541 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
merge
7c48949 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
update submodule
a39103a 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'nnpa-compute-on-ztensor-simd' of github.com:tungld/onnx…
f53491e 
…-mlir into nnpa-compute-on-ztensor-simd
@tungld
merge and resolve conflict
9e35d43 
Signed-off-by: Tung D. Le <tung@jp.ibm.com>
@tungld
Merge branch 'nnpa-compute-on-ztensor-simd' into nnpa-compute-on-ztensor
3b36e23
@tungld
Merge branch 'main' into nnpa-compute-on-ztensor
69f6ed4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@tungld