Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark_processing script #261

Merged
merged 5 commits into from Jun 9, 2021
Merged

Add benchmark_processing script #261

merged 5 commits into from Jun 9, 2021

Conversation

innerlee
Copy link
Contributor

@innerlee innerlee commented Jun 4, 2021

This script go through the training data repeatedly. Useful for data loading benchmark.

Signed-off-by: lizz <lizz@sensetime.com>
@codecov
Copy link

codecov bot commented Jun 4, 2021

Codecov Report

Merging #261 (f70aec5) into main (18e7ecc) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main     #261   +/-   ##
=======================================
  Coverage   85.87%   85.87%           
=======================================
  Files         132      132           
  Lines        8802     8802           
  Branches     1231     1231           
=======================================
  Hits         7559     7559           
  Misses        941      941           
  Partials      302      302           
Flag Coverage Δ
unittests 85.87% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 18e7ecc...f70aec5. Read the comment docs.

tools/run_data.py Outdated Show resolved Hide resolved
tools/run_data.py Outdated Show resolved Hide resolved
tools/run_data.py Outdated Show resolved Hide resolved
tools/run_data.py Outdated Show resolved Hide resolved
@jeffreykuang
Copy link
Collaborator

rename this tool to upload_data_to_mc?

innerlee and others added 4 commits June 4, 2021 17:39
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Signed-off-by: lizz <lizz@sensetime.com>
@innerlee
Copy link
Contributor Author

innerlee commented Jun 4, 2021

I rename the script to benchmark_processing, since it can also be used to find bottleneck in data pipelines. mmpose/mmaction2 also have this script.

@innerlee
Copy link
Contributor Author

innerlee commented Jun 4, 2021

Note in this case, the mc config should be specifed in config, rather than in the cmd line.

@innerlee innerlee changed the title Flush data script Add benchmark_processing script Jun 9, 2021
@innerlee innerlee requested a review from cuhk-hbsun June 9, 2021 09:06
@innerlee innerlee merged commit bb44475 into main Jun 9, 2021
@innerlee innerlee deleted the zz/flush branch June 9, 2021 09:38
gaotongxiao pushed a commit to gaotongxiao/mmocr that referenced this pull request Jul 15, 2022
* Flush data script

Signed-off-by: lizz <lizz@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* rename to benchmark_processing

Signed-off-by: lizz <lizz@sensetime.com>

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
gaotongxiao pushed a commit to gaotongxiao/mmocr that referenced this pull request Jul 15, 2022
* Flush data script

Signed-off-by: lizz <lizz@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* rename to benchmark_processing

Signed-off-by: lizz <lizz@sensetime.com>

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants