Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run fluid models and update current dist train performance result #9401

Closed
typhoonzero opened this issue Mar 27, 2018 · 11 comments
Closed

Run fluid models and update current dist train performance result #9401

typhoonzero opened this issue Mar 27, 2018 · 11 comments

Comments

@typhoonzero
Copy link
Contributor

typhoonzero commented Mar 27, 2018

We need to update performance results under benchmark/cluster to add different models:

codes:

https://github.com/PaddlePaddle/models/tree/develop/fluid

Result metrics:

  • speed of local mode
  • dist mode speed up percentage (CPU/GPU)
@seiriosPlus
Copy link
Collaborator

I will add performance about image_classification.

@putcn
Copy link
Contributor

putcn commented Mar 27, 2018

Me and @helinwang will take sequence_tagging_for_ner

@wangkuiyi
Copy link
Collaborator

Could we do these performance evaluation via the continuous evaluation system developed by @Superjomn ? If so, it seems that the results will be continuously updated and could be shared publicly.

@typhoonzero
Copy link
Contributor Author

@wangkuiyi sure! I will move perf tests to CI system once we have the baseline updated.

@Superjomn
Copy link
Contributor

Superjomn commented Mar 28, 2018

yes, the CE is already online for testing. http://yq01-sys-hic-v100-box-a223-0007.yq01.baidu.com:8111/

One can reference https://github.com/PaddlePaddle/MacroCE/blob/develop/doc/howto.md and PR to https://github.com/Superjomn/paddle-modelci-baseline/tree/fast, the fast branch to add more evaluations. @wangkuiyi @typhoonzero

I will add more docs latter about the branches and how the TeamCity works with it.

@gongweibao
Copy link
Contributor

@wangkuiyi We plan to add later #9046 (comment)

@typhoonzero
Copy link
Contributor Author

@typhoonzero
Copy link
Contributor Author

@putcn I'm currently working on sequence_tagging_for_ner perf data now

@putcn
Copy link
Contributor

putcn commented Apr 9, 2018

@typhoonzero sorry I was working on aws tool, and thanks for taking this over. I made some progress on ner test, please refer to https://github.com/putcn/Paddle/tree/benchmark_cluster_ner if you need anything.

@typhoonzero
Copy link
Contributor Author

Thanks! @putcn

@typhoonzero
Copy link
Contributor Author

typhoonzero commented Apr 10, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

6 participants