[New features] testing example of model zoo #4398
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
Codecov Report
@@ Coverage Diff @@
## develop #4398 +/- ##
========================================
Coverage 41.76% 41.76%
========================================
Files 434 434
Lines 61872 61872
========================================
+ Hits 25840 25841 +1
+ Misses 36032 36031 -1
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
…nto add-gpt-testing
…nto add-gpt-testing
ZHUI
reviewed
Jan 30, 2023
tests/model_zoo/test_gpt.py
Outdated
| # 1. run pretrain | ||
| argv, config = load_argv(self.config_path, "pretrain", return_dict=True) | ||
| device = config["device"] | ||
| sys.argv = argv |
There was a problem hiding this comment.
看能不能改成with之类的写法。这个是全局的，可能造成一些奇怪的问题。
There was a problem hiding this comment.
pretrain_config = load_config(self.config_path, "pretrain")
with test_argv_guard(pretrain_config):
from run_pretrain import do_train
do_train()
ZHUI
reviewed
Jan 30, 2023
| if os.getenv("RUN_SLOW_TEST", None): | ||
| sub_key = "default" | ||
|
|
||
| config = config[sub_key] |
There was a problem hiding this comment.
assert key must be in yaml file !
tests/model_zoo/test_gpt.py
Outdated
| # 1. run pretrain | ||
| argv, config = load_argv(self.config_path, "pretrain", return_dict=True) | ||
| device = config["device"] | ||
| sys.argv = argv |
There was a problem hiding this comment.
pretrain_config = load_config(self.config_path, "pretrain")
with test_argv_guard(pretrain_config):
from run_pretrain import do_train
do_train()
ZHUI
reviewed
Jan 30, 2023
tests/fixtures/model_zoo/gpt.yaml
Outdated
| @@ -0,0 +1,99 @@ | |||
| pretrain: | |||
| tiny: | |||
There was a problem hiding this comment.
Suggested change
| tiny: | |
| slow: |
ZHUI
reviewed
Jan 31, 2023
ZHUI
previously approved these changes
Jan 31, 2023
Co-authored-by: Zhong Hui <zhonghui.net@gmail.com>
ZHUI
reviewed
Jan 31, 2023
scripts/regression/ci_case.sh
Outdated
| python gpt_sample.py >${log_path}/fast_generation_gpt >>${log_path}/fast_generation_gpt 2>&1 | ||
| print_info $? fast_generation_gpt | ||
| echo 'skip gpt testing in paddle-ci, for details you can see: https://github.com/PaddlePaddle/PaddleNLP/pull/4398' | ||
| # if [ ! -f 'test.py' ];then |
There was a problem hiding this comment.
我先把gpt 的函数体代码给删掉，这里留一个 todo 让军军去删除其他关联的脚本（免得没删干净导致一些运行时的 bug）
|
这里还没添加：在 pytest 中进行多卡测试的示例代码，此模块将会在另外一个 pr 中完成。 |
ZHUI
approved these changes
Jan 31, 2023
Yam0214
added a commit
to Yam0214/PaddleNLP
that referenced
this pull request
Jan 31, 2023
joey12300
pushed a commit
that referenced
this pull request
Feb 20, 2023
* update model_zoo/ernie-m * add logging eval infomations * delete unused testing code * add tests samples for xnli * fewer tests samples for xnli * add predict and export * add predictor and serving * fix export error when training with data parallelism * fix mkdir error in distributed training and use ERNIEMHandler * adjust predictor * modify ci accroding to #4398 and adjust predictor * enable load tiny dataset for ci * support testing infer with precision_mode fp16 * modify ci script * Update ci_case.sh * enable to test inputs_embeds for enire-m * fix ci script * fix using fast tokenizer * using set_optimizer_grouped_parameters instead * consturct optimizer with layerwise_lr_decay out of Trainer
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
New features
PR changes
Models
Description
Model Zoo GPT 单测样板间