Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce number of distributed tests. #2270

Merged
merged 8 commits into from
Jul 13, 2022
Merged

Conversation

justinxzhao
Copy link
Collaborator

@justinxzhao justinxzhao commented Jul 13, 2022

Ludwig distributed unit tests frequently exceed the 50 minute timeout.

Some tests seem like they don't need to be distributed, while in other cases overparameterization can be wasteful.

Primary changes:

  • Refactored ray-related automl utilities into a separate library, i.e. ray_utils.py, enabling type inference tests to run non-distributed.
  • Reduced the number of hyperopt tests by decreasing the parameterization spaces for search algorithms and schedulers.
  • Un-distribute tests where they don't need to be distributed.

@github-actions
Copy link

github-actions bot commented Jul 13, 2022

Unit Test Results

       6 files  +    2         6 suites  +2   2h 21m 35s ⏱️ + 49m 35s
2 912 tests  -   18  2 866 ✔️  -   18    46 💤 ±  0  0 ±0 
8 736 runs  +288  8 594 ✔️ +242  142 💤 +46  0 ±0 

Results for commit 7108501. ± Comparison against base commit 6ee335f.

♻️ This comment has been updated with latest results.

@justinxzhao justinxzhao marked this pull request as ready for review July 13, 2022 19:32
@tgaddair tgaddair changed the title Attempt to reduce number of distributed tests. Reduce number of distributed tests. Jul 13, 2022
@justinxzhao justinxzhao merged commit 756506b into master Jul 13, 2022
@justinxzhao justinxzhao deleted the reduce_distributed_tests branch July 13, 2022 20:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants