Skip to content

[BUG Fix] Fix the NVCC Comple options for CUDA Version >= 12.5 #143

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 191 commits into from
Aug 14, 2024
Merged

[BUG Fix] Fix the NVCC Comple options for CUDA Version >= 12.5 #143

merged 191 commits into from
Aug 14, 2024

Conversation

@LeiWang1999
Copy link
Contributor

@LeiWang1999 LeiWang1999 commented Aug 13, 2024

Looks like the -gencode=arch=compute_80,code=compute_80 flags should be replaced by arch=compute_80,code=sm_80 when the version of nvcc is greater than 12.5. Otherwise the shared library may have unkown behavior.

ref to issue #131 #120

LeiWang1999 added 30 commits July 5, 2024 08:54
@LeiWang1999
Refactor BatchMatMulEmitter and BatchMatMulSelector for improved read…
d8884e6 
…ability and maintainability
@LeiWang1999
Refactor import statements for improved readability and maintainability
fc84173
@LeiWang1999
Refactor import statements for improved readability and maintainability
02f64de
@LeiWang1999
disable failure email for ci
397eee6
@LeiWang1999
remove email notifications.
20f6ad1
@LeiWang1999
move relax pass from testing to mlc_llm
b93c394
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
ba6a6df
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
257693a
@LeiWang1999
Lint Fix
9bb7f49
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
39e7614
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
93eb5a5
@LeiWang1999
bug fix in test
aa66a90
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
ae14a53
@LeiWang1999
lint fix.
79b08e4
@LeiWang1999
test cuda i4 kernel
86fd036
@LeiWang1999
Refactor copyright notice in i4matmul.hpp
6b73a21
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
0ba90c1
@LeiWang1999
Refactor BitBLASLinear test module for improved readability and maint…
086d208 
…ainability
@LeiWang1999
refactor test as version below python 3.9 cannot handle int32 overflow.
47a3abd
@LeiWang1999
format lint for test
024b247
@LeiWang1999
Refactor test_int4b_fp16_convert.py for improved readability and main…
bfedeaa 
…tainability
@LeiWang1999
remove unused design file
e672a23
@LeiWang1999
move tile device from package to base
21e5430
@LeiWang1999
dummy impl for codegen
fd11940
@LeiWang1999
Refactor file structure for ladder_permutate module
9ccfa85
@LeiWang1999
Refactor backend class and fix typos in comments
7c7d73e
@LeiWang1999
Deep refactor Lib related code.
47d5fc5
@LeiWang1999
remove ci pull.
53dd0dd
@LeiWang1999
LintFix
d58ac43
@LeiWang1999
refactor builder for whl build
37cb07c
LeiWang1999 and others added 28 commits August 9, 2024 07:29
@LeiWang1999
revert optimize_stratety into SingleBatchDecodeOnly
4e8ab23
@LeiWang1999
typofix
8177e2f
@LeiWang1999
update benchmark scripts
113e485
@LeiWang1999
chore: Refactor benchmark scripts and fix typos
46b2d7d
@LeiWang1999
fix for testing
9ecbb48
@LeiWang1999
lint fix
fb128ed
@LeiWang1999
fix import.
9b5e106
@LeiWang1999
typo
54b4044
@LeiWang1999
operator benchmark
23f88b7
@LeiWang1999
optimize
bcffc49
@LeiWang1999
always with shared.dyn
8b5f083
@LeiWang1999
optimize cache.
54b5d3f
@LeiWang1999
dsl fix
4289d7b
@LeiWang1999
Merge branch 'main' into update_transform
72a1863
@LeiWang1999
tqdm
2327e14
@LeiWang1999
Merge branch 'update_transform' of https://github.com/LeiWang1999/MSB…
40a9b04 
…itBLAS into update_transform
@LeiWang1999
chore: Add serialize_results method to benchmark_matmul_strategies.py
a16ee62
@LeiWang1999
fix performance issue for dynamic async copy
63fc654
@LeiWang1999
chore: Refactor benchmark_matmul_strategies.py for improved performan…
d37d09f 
…ce and code readability
@LeiWang1999
bug fix
d4d4603
@LeiWang1999
update readme
1816526
@LeiWang1999
disable block reduce for int8
b81a3a8
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into upda…
9cde970 
…te_transform
@LeiWang1999
bugfix for bitnet
1c89c60
@LeiWang1999
annotatte todo.
cfda648
@LeiWang1999
lint fix
83b99c4
@LeiWang1999
regist fast_decode for int8xint4
0b6b4a3
@LeiWang1999
Refactor CUDA code to use sm architecture instead of compute architec…
e93d1de 
…ture
@LeiWang1999 LeiWang1999 merged commit 60f3e5d into microsoft:main Aug 14, 2024
@LeiWang1999 LeiWang1999 mentioned this pull request Aug 14, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@LeiWang1999