Add ernie c++ inference test #21015
Merged
Add ernie c++ inference test #21015
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
test=develop
Xreki
reviewed
Nov 5, 2019
|
|
||
| void SetConfig(AnalysisConfig *cfg) { | ||
| cfg->SetModel(FLAGS_infer_model); | ||
| cfg->DisableGpu(); |
| 1.20926, -1.62216, 0.202339, -0.51834, -0.255833, 0.403484, | ||
| -1.61329, 2.44492, -0.621071, 1.93191, -2.43418, 0.252749, | ||
| 3.9044, -2.59725, -0.988252, -1.72084, 2.54846, -0.660083, | ||
| -0.907154, -0.903408, 1.83843, 0.94278, -2.09705, 0.819825}; |
luotao1
reviewed
Nov 5, 2019
| cfg->SwitchIrOptim(); | ||
| cfg->SetCpuMathLibraryNumThreads(FLAGS_paddle_num_threads); | ||
| if (FLAGS_zero_copy) { | ||
| cfg->SwitchUseFeedFetchOps(false); |
There was a problem hiding this comment.
FLAGS_zero_copy不只是加这一行，
- 如果打开开关不能跑的话，这个PR可以先去掉。
- 如果要支持的话，请参考 https://github.com/PaddlePaddle/Paddle/compare/develop...luotao1:bert_zero_copy?expand=1 并给出zero_copy在这个模型上是否有加速的benchmark result
There was a problem hiding this comment.
打开开关之后有问题，已去掉zero_copy。
luotao1
reviewed
Nov 5, 2019
| @@ -129,6 +129,11 @@ set(PYRAMID_DNN_INSTALL_DIR "${INFERENCE_DEMO_INSTALL_DIR}/pyramid_dnn") | |||
| download_model_and_data(${PYRAMID_DNN_INSTALL_DIR} "PyramidDNN_model.tar.gz" "PyramidDNN_data.txt.tar.gz") | |||
| inference_analysis_api_test(test_analyzer_pyramid_dnn ${PYRAMID_DNN_INSTALL_DIR} analyzer_pyramid_dnn_tester.cc) | |||
|
|
|||
| #Ernie | |||
| set(ERNIE_INSTALL_DIR "${INFERENCE_DEMO_INSTALL_DIR}/ernie") | |||
There was a problem hiding this comment.
因为CI会缓存目录，重新上传后，请换一个目录名字，比如Ernie
test=develop
test=develop
test=develop
Xreki
reviewed
Nov 7, 2019
|
|
||
| if (use_mkldnn) { | ||
| config.EnableMKLDNN(); | ||
| config.pass_builder()->AppendPass("fc_mkldnn_pass"); |
There was a problem hiding this comment.
fc_mkldnn_pass属于可加可不加。如果fc_mkldnn_pass对ernie没有性能提速的话，不需要加。
|
|
||
| if (use_gpu) { | ||
| config.EnableUseGpu(100, 0); | ||
| } |
There was a problem hiding this comment.
line 144 - 151可以挪到SetConfig函数里面。
There was a problem hiding this comment.
两个位置都移动到SetConfig函数里
test=develop
seiriosPlus
pushed a commit
to seiriosPlus/Paddle
that referenced
this pull request
Dec 9, 2019
* Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop
seiriosPlus
pushed a commit
to seiriosPlus/Paddle
that referenced
this pull request
Dec 9, 2019
* Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop
GaoWei8
added a commit
to GaoWei8/Paddle
that referenced
this pull request
Jan 9, 2020
* Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop
Xreki
pushed a commit
that referenced
this pull request
Jan 10, 2020
…22198) * Optimize the kernel implementation of layernorm with openmp (#20895) * Add ernie c++ inference test (#21015) * Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop * fix cmake fails on inference_download_and_uncompress (#21185) * solve cmake fails on inference_download_and_uncompress test=develop * solve cmake fails on inference_download_and_uncompress test=develop * Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop * Polish the codes of fc when needs padding (#21378) test=develop * Add ernie large c++ inference test (#21365) * add ernie-large test test=develop * add ernie large c++ inference test test=develop * Modify padding strategy: remove weight copy in fc padding (#21650) test=develop * optimize fc jit (#21878) test=develop Co-authored-by: Yihua Xu <yihuaxu@hotmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add ernie c++ inference test