Skip to content

Add bfp16/int8 support into XDL GEMM operator#50

Merged
asroy merged 49 commits into
developfrom
add_bfp16_int8_gemm
Nov 15, 2021
Merged

Add bfp16/int8 support into XDL GEMM operator#50
asroy merged 49 commits into
developfrom
add_bfp16_int8_gemm

Conversation

@zjing14
Copy link
Copy Markdown
Contributor

@zjing14 zjing14 commented Nov 11, 2021 •
edited
Loading

Jing Zhang and others added 30 commits August 31, 2021 15:21
init StaticBufferV2
3dd0e33
refactor xdlops_gemm for staticbuffer_v2
e6ec57f
clean
dc119ff
adopt old output stage for staticBufferV2
51edf68
clean
d28150b
remove hack
894b8ab
clean
b9fb0ff
clean
78face5
add parameters
50fc386
clean code
ca62bc0
move c_buffer alloc into blockwise gemm
eb62786
Merge branch 'develop' into static_buffer_vec_type
62a0078
add adaptors for m/n_thread_data_on_grid
f272110
tweak gemm
0fe6e25
adjust blockwise_gemm_xdlops
2d6560e
@asroy
tweak
119126d
update conv
bc8df7e
Merge branch 'improve_gemm' of github.com:ROCmSoftwarePlatform/compos…
123b1a1 
…able_kernel into improve_gemm
update script
6e7cb37
adding bwd 1x1
a53cd93
update script
2c40b17
adding 1x1 bwd
9605757
debugging bwd 1x1 failure
a6266ff
update script
3b4ead0
update script
2c4997f
test
63b8c27
Merge remote-tracking branch 'origin/static_buffer_vec_type' into imp…
7fd96dc 
…rove_gemm
test v100
d9bbf7c
add bf16_1k
74b96ed
clang-format
0d352b0
@zjing14 zjing14 changed the base branch from master to develop November 11, 2021 18:08
@zjing14 zjing14 requested review from asroy and j4yan November 11, 2021 18:28
@zjing14 zjing14 changed the title Add bfp16/int8 support into xdlops gemm Add bfp16/int8 support into Gemm Nov 11, 2021
@asroy
Copy link
Copy Markdown
Contributor

asroy commented Nov 14, 2021 •
edited
Loading

@zjing14 is #37 still needed after this one is merged?

@zjing14
Copy link
Copy Markdown
Contributor Author

zjing14 commented Nov 15, 2021

@asroy No. PR #37 is fully included in this PR.

@zjing14 zjing14 mentioned this pull request Nov 15, 2021
Closed
@asroy asroy changed the title Add bfp16/int8 support into Gemm Add bfp16/int8 support into XDL GEMM operator Nov 15, 2021
@asroy asroy merged commit 3737bb0 into develop Nov 15, 2021
@junliume junliume deleted the add_bfp16_int8_gemm branch October 21, 2023 06:09
carlushuang pushed a commit that referenced this pull request Apr 26, 2024
@rocking5566
Layernorm fwd gamma beta1d (#50)
3a30847 
* Load 1d gamma and beta for each thread

* adjust loop order, avoid cast gamma & beta repeately

* Refine naming
@SamiAario-AMD SamiAario-AMD mentioned this pull request Sep 24, 2025
Merged
7 tasks
@illsilin illsilin mentioned this pull request Oct 15, 2025
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@asroy asroy Awaiting requested review from asroy

@j4yan j4yan Awaiting requested review from j4yan

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@zjing14 @asroy