Skip to content

[swizzle] update smem swizzle layout tools✔️ #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 28, 2024
Merged

[swizzle] update smem swizzle layout tools✔️ #197

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 6 additions & 12 deletions kernels/swizzle/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,12 +3,12 @@
## 📚 build bin

```bash
make
make # build all default binaries
```

## 📚 ncu profile

Achieve 0 bank conflicts for LDSM via smem swizzle.
- 📚 Achieve 0 bank conflicts for LDSM via smem swizzle.

```bash
ncu --metrics l1tex__data_bank_reads ./mat_trans_swizzle.bin
Expand All @@ -20,7 +20,7 @@ ncu --metrics l1tex__data_bank_conflicts_pipe_lsu_mem_shared_op_ld ./hgemm_mma_s
ncu --metrics sm__sass_l1tex_data_bank_conflicts_pipe_lsu_mem_shared_op_ldsm ./hgemm_mma_swizzle.bin 1024 1024 1024 0 1
```

log: (achieve 0 bank conflicts for LDSM via smem swizzle)
- 📚 log: (achieve 0 bank conflicts for LDSM via smem swizzle)

```bash
ncu --metrics sm__sass_l1tex_data_bank_conflicts_pipe_lsu_mem_shared_op_ldsm ./hgemm_mma_swizzle.bin 1024 1024 1024 0 1
Expand Down Expand Up @@ -72,16 +72,10 @@ ncu --metrics sm__sass_l1tex_data_bank_conflicts_pipe_lsu_mem_shared_op_ldsm ./h

## 📚 performance

- NVIDIA TRX 3080 Laptop
- 📚 NVIDIA RTX 3080 Laptop
```bash
./hgemm_mma_swizzle.bin 4096 4096 4096 1 10

ALGO = HGEMM MMA NAIVE
M N K = 4096 4096 4096, W = 1, R = 10, Time = 0.02986609 s, AVG Performance = 4.6018 Tflops

ALGO = HGEMM MMA NAIVE + SMEM SWIZZLE
M N K = 4096 4096 4096, W = 1, R = 10, Time = 0.02860964 s, AVG Performance = 4.8039 Tflops

ALGO = HGEMM mma2x4_warp4x4
M N K = 4096 4096 4096, W = 1, R = 10, Time = 0.00392888 s, AVG Performance = 34.9817 Tflops

Expand All @@ -92,7 +86,7 @@ M N K = 4096 4096 4096, W = 1, R = 10, Time = 0.00234496 s, AVG Performa

## 📚 print swizzle layout

- M16K16
- 📚 M16K16

```bash
python3 print_swizzle_layout.py --logical-col 64 --show-logical-col
Expand Down Expand Up @@ -147,7 +141,7 @@ smem col 0~16, step 8-
----------------------
```

- M16K64
- 📚 M16K64 (Zigzag)

```bash
python3 print_swizzle_layout.py --logical-col 64 --show-logical-col
Expand Down