Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable three flaky tests #3657

Merged
merged 5 commits into from
Mar 25, 2021
Merged

Conversation

@hcho3 hcho3 requested review from a team as code owners March 25, 2021 02:44
@hcho3 hcho3 added the non-breaking Non-breaking change label Mar 25, 2021
@github-actions github-actions bot added CUDA/C++ Cython / Python Cython or Python issue labels Mar 25, 2021
@hcho3 hcho3 added CUDA / C++ CUDA issue tests Unit testing for project gpuCI gpuCI issue 3 - Ready for Review Ready for review by team improvement Improvement / enhancement to an existing function and removed CUDA/C++ gpuCI gpuCI issue labels Mar 25, 2021
Copy link
Member

@dantegd dantegd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one comment

@@ -207,7 +207,8 @@ class silhouetteScoreTest
//setting test parameter values
const std::vector<silhouetteScoreParam> inputs = {
{4, 2, 3, raft::distance::DistanceType::L2Expanded, 4, 0.00001},
{4, 2, 2, raft::distance::DistanceType::L2SqrtUnexpanded, 2, 0.00001},
// FIXME: temporarily disabled due to flaky test
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If possible could you use GTEST_SKIP so we get a reminder of the number of disabled tests during test runs? (example

GTEST_SKIP(); // Skip the test for double imput
)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if it's doable, since the test is parameterized, and I'm disabling just a single parameterization.

@codecov-io
Copy link

Codecov Report

Merging #3657 (51d12f8) into branch-0.19 (fd9ec89) will decrease coverage by 35.58%.
The diff coverage is 35.29%.

Impacted file tree graph

@@               Coverage Diff                @@
##           branch-0.19    #3657       +/-   ##
================================================
- Coverage        80.70%   45.12%   -35.59%     
================================================
  Files              227      224        -3     
  Lines            17615    17121      -494     
================================================
- Hits             14217     7726     -6491     
- Misses            3398     9395     +5997     
Flag Coverage Δ
dask 45.12% <35.29%> (+0.13%) ⬆️
non-dask ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
python/cuml/cluster/kmeans.pyx 58.29% <ø> (-33.67%) ⬇️
python/cuml/common/memory_utils.py 65.85% <0.00%> (-13.27%) ⬇️
python/cuml/fil/fil.pyx 63.26% <ø> (-28.58%) ⬇️
python/cuml/neighbors/__init__.py 100.00% <ø> (ø)
python/cuml/neighbors/ann.pyx 8.04% <0.00%> (-53.59%) ⬇️
python/cuml/neighbors/nearest_neighbors.pyx 41.47% <0.00%> (-51.18%) ⬇️
python/cuml/pipeline/__init__.py 0.00% <0.00%> (ø)
python/cuml/preprocessing/encoders.py 88.04% <ø> (-7.04%) ⬇️
python/cuml/solvers/qn.pyx 17.31% <7.14%> (-80.32%) ⬇️
python/cuml/linear_model/logistic_regression.pyx 20.19% <7.40%> (-68.77%) ⬇️
... and 145 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5a82fdb...51d12f8. Read the comment docs.

@dantegd
Copy link
Member

dantegd commented Mar 25, 2021

@gpucibot merge

@rapids-bot rapids-bot bot merged commit f5f03bf into rapidsai:branch-0.19 Mar 25, 2021
@hcho3 hcho3 deleted the disable_flaky_tests branch March 25, 2021 16:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team CUDA / C++ CUDA issue Cython / Python Cython or Python issue improvement Improvement / enhancement to an existing function non-breaking Non-breaking change tests Unit testing for project
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants