Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run Haar application gallery example in single-threaded mode #5241

Closed
wants to merge 1 commit into from

Conversation

grlee77
Copy link
Contributor

@grlee77 grlee77 commented Feb 18, 2021

Description

I have noticed occasional timeouts on Azure when running the gallery examples on CI. When testing locally, plot_haar_extraction_selection_classification.py alone accounts for the majority of the time.

On my system with 10 cores, single-threaded operation is nearly an order of magnitude faster than running multi-threaded. This is probably due to relatively low computational complexity of the features leading to memory access times dominating the performance.

If the run time on Azure when checking the gallery examples is substantially reduced, we can consider merging this PR as is. If not, then another option to approximately halve the example time would be to reduce the number of images used for training from 200 to 100.

Checklist

For reviewers

  • Check that the PR title is short, concise, and will make sense 1 year
    later.
  • Check that new functions are imported in corresponding __init__.py.
  • Check that new features, API changes, and deprecations are mentioned in
    doc/release/release_dev.rst.

…xample

single-threaded is much faster than multi-threaded when testing locally
@grlee77
Copy link
Contributor Author

grlee77 commented Feb 18, 2021

I am going to close this because it does not seem to be the cause of the timeouts. Looking back through some other successful logs, this test seems to take < 2 minutes. When timeouts occur it seems to be more due to excessive time in installing the packages into the environment.

@grlee77 grlee77 closed this Feb 18, 2021
@grlee77 grlee77 deleted the gallery_example_speedup branch July 8, 2021 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant