Skip to content

update stable diffusion script and doc#15846

Merged
tianleiwu merged 3 commits intomainfrom
tlwu/update_sd_script_doc
May 9, 2023
Merged

update stable diffusion script and doc#15846
tianleiwu merged 3 commits intomainfrom
tlwu/update_sd_script_doc

Conversation

@tianleiwu
Copy link
Contributor

Description

Update script:
(1) change some float16 verbose logging to debug level.
(2) Let requirements-cuda.txt includes requirements.txt
(3) Use an environment variable ORT_DISABLE_TRT_FLASH_ATTENTION=1 to avoid black image in 2.1 model. Update benchmark and doc.
(4) Update document to include command lines to build ORT rocm from source.
(5) Update optimize_pipeline.py so that user can disable packed qkv/kv from command line options.
(6) Update document to use torch < 2.0 for onnx export.

Motivation and Context

@tianleiwu tianleiwu requested review from cloudhan and yufenglee May 8, 2023 15:56
@tianleiwu tianleiwu requested a review from cloudhan May 9, 2023 08:54
Comment on lines +131 to +134
pip install numpy packaging "wheel>=0.35.1"
wget --quiet https://github.com/Kitware/CMake/releases/download/v3.26.3/cmake-3.26.3-linux-x86_64.tar.gz
tar zxf cmake-3.26.3-linux-x86_64.tar.gz
export PATH=${PWD}/cmake-3.26.3-linux-x86_64/bin:${PATH}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about

pip install numpy packaging "wheel>=0.35.1" cmake==3.26.3

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll have a try and update it later if it is working.

Copy link
Contributor

@cloudhan cloudhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Otherwise, LGTM

@tianleiwu tianleiwu merged commit e0c1fa3 into main May 9, 2023
@tianleiwu tianleiwu deleted the tlwu/update_sd_script_doc branch May 9, 2023 22:29
fs-eire pushed a commit that referenced this pull request May 12, 2023
### Description
Update script: 
(1) change some float16 verbose logging to debug level.
(2) Let requirements-cuda.txt includes requirements.txt
(3) Use an environment variable ORT_DISABLE_TRT_FLASH_ATTENTION=1 to
avoid black image in 2.1 model. Update benchmark and doc.
(4) Update document to include command lines to build ORT rocm from
source.
(5) Update optimize_pipeline.py so that user can disable packed qkv/kv
from command line options.
(6) Update document to use torch < 2.0 for onnx export.

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
prathikr pushed a commit that referenced this pull request May 16, 2023
### Description
Update script: 
(1) change some float16 verbose logging to debug level.
(2) Let requirements-cuda.txt includes requirements.txt
(3) Use an environment variable ORT_DISABLE_TRT_FLASH_ATTENTION=1 to
avoid black image in 2.1 model. Update benchmark and doc.
(4) Update document to include command lines to build ORT rocm from
source.
(5) Update optimize_pipeline.py so that user can disable packed qkv/kv
from command line options.
(6) Update document to use torch < 2.0 for onnx export.

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants