Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Auto Parallel]Update AutoTuner #56939

Merged
merged 17 commits into from
Sep 25, 2023

Conversation

Caozhou1995
Copy link
Contributor

@Caozhou1995 Caozhou1995 commented Sep 4, 2023

PR types

New features

PR changes

Others

Description

Pcard-75602
This PR includes the following points:

  1. Support for Virtual pipeline degree automatic search
  2. Support for JSON/YAML injection
  3. Support SP injection commands
  4. Display AccStep in csv
  5. Add max_search_time field and adjusting search dimension candidate values
  6. Specify values for certain parameters during search and runtime stage

@paddle-bot
Copy link

paddle-bot bot commented Sep 4, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@Caozhou1995 Caozhou1995 force-pushed the add_vpp_search branch 5 times, most recently from c59eeb7 to 6d7753a Compare September 8, 2023 09:21
@zhaoyinglia zhaoyinglia merged commit 9c3bffb into PaddlePaddle:develop Sep 25, 2023
27 checks passed
Frida-a pushed a commit to Frida-a/Paddle that referenced this pull request Oct 14, 2023
* add vpp search

* support cmd json or yaml

* add auto tuner log

* add OOM prune

* support sft and lora best cfg

* support sp

* fix sft/lora cfg

* fix json/yaml bug and update multi nodes status

* add pp and mp prune flag

* update log and csv path

* merge dev

* speed prune

* add search stage and run best stage cmd

* fix recompute_granularity prune bug

* fix get best cfg in sft and lora mode bug

* fix single card bug

* update read metric
jiahy0825 pushed a commit to jiahy0825/Paddle that referenced this pull request Oct 16, 2023
* add vpp search

* support cmd json or yaml

* add auto tuner log

* add OOM prune

* support sft and lora best cfg

* support sp

* fix sft/lora cfg

* fix json/yaml bug and update multi nodes status

* add pp and mp prune flag

* update log and csv path

* merge dev

* speed prune

* add search stage and run best stage cmd

* fix recompute_granularity prune bug

* fix get best cfg in sft and lora mode bug

* fix single card bug

* update read metric
danleifeng pushed a commit to danleifeng/Paddle that referenced this pull request Nov 14, 2023
* add vpp search

* support cmd json or yaml

* add auto tuner log

* add OOM prune

* support sft and lora best cfg

* support sp

* fix sft/lora cfg

* fix json/yaml bug and update multi nodes status

* add pp and mp prune flag

* update log and csv path

* merge dev

* speed prune

* add search stage and run best stage cmd

* fix recompute_granularity prune bug

* fix get best cfg in sft and lora mode bug

* fix single card bug

* update read metric
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants