This repository has been archived by the owner on Jan 24, 2024. It is now read-only.
Add vgg16 aws dist test #27
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
It seems that in AWS, CPU performance has some stable difference.
add multi card for text_classification
Update actived to false for image classification
|
Please do NOT merge, PR is not ready yet. |
|
PR is ready for review |
|
陈老师， 你这个pr有点大啊，看你这个ce task check已经过了， 应该问题不大。 |
|
我看了下ce task的job， 这个task 总共大概1小时， 其中编译+ 部署大概40min， 这个时间略长，后续考虑怎么优化下吧 |
Superjomn
suggested changes
Jun 3, 2018
vgg16_aws_dist/ce_runner.py
Outdated
| kpi_to_track = LessWorseKpi(name, 0.01) | ||
| kpi_to_track.add_record(np.array(val, dtype='float32')) | ||
|
|
||
| class DataCollector(object): |
There was a problem hiding this comment.
Please run pre-commit run -a to automatically format the code style.
|
this PR is rebased and recommitted with another one #33 |
|
@guochaorong 编译主要是CE在编译最新的paddle, 这个是我这边没有控制的. 编译完成后生成docker image并且push出去应该不会太久, 剩下就是创建aws instance和执行测试, 这个过程是这个测试里面耗时最长的, 但是也没有什么可以优化的了, 可以并行的都已经在并行测试了. 目前是安排了三个cluster config的测试, 相当于普通测试要跑1.5遍(前两个并行, 最后一个串行), 并且要加上instance的allocate时间. |
|
@Superjomn 重新rebase后往master提交了新的PR. 增加了一些注释来解释过程. 提交前执行了pre-commit. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.