Skip to content

update requirements #5826

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Sep 16, 2025
Merged

update requirements #5826

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
bdea6ba
update requirements
Jintao-Huang Sep 16, 2025
f1a77bc
fix
Jintao-Huang Sep 16, 2025
d99d9f0
update
Jintao-Huang Sep 16, 2025
ac74889
update
Jintao-Huang Sep 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,18 +124,18 @@ Running Environment:

| | Range | Recommended | Notes |
|--------------|--------------|---------------------|-------------------------------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | Training |
| vllm | >=0.5.1 | 0.10 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.9.post6 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2 | Inference/Deployment |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |
Comment on lines +127 to +138
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Please consider re-aligning the columns for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | Training |
| vllm | >=0.5.1 | 0.10 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.9.post6 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2 | Inference/Deployment |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |

| evalscope | >=0.11 | | Evaluation |
| gradio | | 5.32.1 | Web-UI/App |

Expand Down
12 changes: 6 additions & 6 deletions README_CN.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -120,18 +120,18 @@ pip install -e .

| | 范围 | 推荐 | 备注 |
|--------------|--------------|---------------------|--------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | 训练 |
| vllm | >=0.5.1 | 0.10 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.9.post6 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2 | 推理/部署 |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |
Comment on lines +123 to +134
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Please consider re-aligning the columns for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | 训练 |
| vllm | >=0.5.1 | 0.10 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.9.post6 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2 | 推理/部署 |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |

| evalscope | >=0.11 | | 评测 |
| gradio | | 5.32.1 | Web-UI/App |

Expand Down
12 changes: 6 additions & 6 deletions docs/source/GetStarted/SWIFT安装.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,18 +91,18 @@ modelscope-registry.us-west-1.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu2

| | 范围 | 推荐 | 备注 |
|--------------|--------------|---------------------|--------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | 训练 |
| vllm | >=0.5.1 | 0.10 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.9.post6 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2 | 推理/部署 |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |
Comment on lines +94 to +105
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Please consider re-aligning the columns for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | 训练 |
| vllm | >=0.5.1 | 0.10 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.9.post6 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2 | 推理/部署 |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | 使用cpu、npu、mps则无需安装 |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.17.5 | 训练 |
| vllm | >=0.5.1 | 0.10.1.1 | 推理/部署 |
| sglang | >=0.4.6 | 0.4.10.post2 | 推理/部署 |
| lmdeploy | >=0.5 | 0.9.2.post1 | 推理/部署 |

| evalscope | >=0.11 | | 评测 |
| gradio | | 5.32.1 | Web-UI/App |

Expand Down
4 changes: 2 additions & 2 deletions docs/source/Megatron-SWIFT/快速开始.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,14 +45,14 @@ modelscope-registry.us-west-1.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu2
推荐运行环境：
| | 范围 | 推荐 | 备注 |
|--------------|--------------|-------------|--------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.51.3 | |
| transformers | >=4.33 | 4.56.1 | |
Comment on lines +48 to +55
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Additionally, the apex row seems to have an incorrect number of columns. Please consider re-aligning the columns and fixing the table structure for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.51.3 | |
| transformers | >=4.33 | 4.56.1 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.56.1 | |

| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | LoRA |
| trl | >=0.15,<0.21 | | RLHF |
Expand Down
12 changes: 6 additions & 6 deletions docs/source_en/GetStarted/SWIFT-installation.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -92,18 +92,18 @@ More images can be found [here](https://modelscope.cn/docs/intro/environment-set

| | Range | Recommended | Notes |
|--------------|--------------|---------------------|-------------------------------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | Training |
| vllm | >=0.5.1 | 0.10 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.9.post6 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2 | Inference/Deployment |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |
Comment on lines +95 to +106
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Please consider re-aligning the columns for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.55.4 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.16.9 | Training |
| vllm | >=0.5.1 | 0.10 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.9.post6 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2 | Inference/Deployment |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | No need to install if using CPU, NPU, MPS |
| torch | >=2.0 | 2.7.1 | |
| transformers | >=4.33 | 4.56.1 | |
| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| trl | >=0.15,<0.21 | 0.20.0 | RLHF |
| deepspeed | >=0.14 | 0.17.5 | Training |
| vllm | >=0.5.1 | 0.10.1.1 | Inference/Deployment |
| sglang | >=0.4.6 | 0.4.10.post2 | Inference/Deployment |
| lmdeploy | >=0.5 | 0.9.2.post1 | Inference/Deployment |

| evalscope | >=0.11 | | Evaluation |
| gradio | | 5.32.1 | Web-UI/App |

Expand Down
4 changes: 2 additions & 2 deletions docs/source_en/Megatron-SWIFT/Quick-start.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,14 +46,14 @@ Recommended Operating Environment:

| | Range | Recommended | Notes |
|--------------|--------------|-------------|--------------------|
| python | >=3.9 | 3.10 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.51.3 | |
| transformers | >=4.33 | 4.56.1 | |
Comment on lines +49 to +56
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The formatting of this table has become misaligned after the recent updates, which affects readability. Additionally, the apex row seems to have an incorrect number of columns. Please consider re-aligning the columns and fixing the table structure for better presentation.

Suggested change
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.51.3 | |
| transformers | >=4.33 | 4.56.1 | |
| python | >=3.9 | 3.10/3.11 | |
| cuda | | cuda12 | |
| torch | >=2.0 | 2.6.0/2.7.1 | |
| transformer_engine | >=2.3 | | |
| apex | | 0.1 | |
| megatron_core | >=0.12 | 0.13 | |
| flash_attn | | 2.7.4.post1/3.0.0b1 | |
| transformers | >=4.33 | 4.56.1 | |

| modelscope | >=1.23 | | |
| peft | >=0.11,<0.18 | | LoRA |
| trl | >=0.15,<0.21 | | RLHF |
Expand Down
10 changes: 5 additions & 5 deletions requirements/install_all.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
# please use python=3.10, cuda12.*
# sh requirements/install_all.sh
pip install "sglang[all]<0.5" -U
pip install "vllm>=0.5.1" "transformers<4.56" "trl<0.21" -U
pip install "vllm>=0.5.1,<0.10.2" "transformers<4.57" "trl<0.21" -U
pip install "lmdeploy>=0.5" -U
pip install autoawq -U --no-deps
pip install auto_gptq optimum bitsandbytes "gradio<5.33" -U
pip install git+https://github.com/modelscope/ms-swift.git
pip install timm -U
pip install "deepspeed" -U
pip install qwen_vl_utils qwen_omni_utils decord librosa icecream soundfile -U
pip install liger_kernel nvitop pre-commit math_verify py-spy -U
pip install timm deepspeed -U
pip install qwen_vl_utils qwen_omni_utils keye_vl_utils -U
pip install decord librosa icecream soundfile -U
pip install liger_kernel nvitop pre-commit math_verify==0.5.2 py-spy wandb swanlab -U
# flash-attn: https://github.com/Dao-AILab/flash-attention/releases
3 changes: 2 additions & 1 deletion tests/test_align/test_template/test_vision.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -748,8 +748,9 @@ def test_minicpmv4_5():
# test_glm4_1v()
# test_gemma3n()
# test_keye_vl()
test_keye_vl_1_5()
# test_dots_ocr()
# test_glm4_5v()
# test_interns1()
# test_internvl3_5()
test_minicpmv4_5()
# test_minicpmv4_5()
Loading