Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Speed-up test suite execution #3402

Closed
ogrisel opened this Issue Jul 16, 2014 · 9 comments

Comments

Projects
None yet
3 participants
Owner

ogrisel commented Jul 16, 2014

Here is the top of a nose-timer run on the current master:

sklearn.ensemble.tests.test_weight_boosting.test_sparse_classification: 6.2676s
sklearn.externals.joblib.test.test_parallel.test_simple_parallel(<multiprocessing.context.SpawnContext object at 0x101cb9c50>,): 4.9354s
sklearn.cluster.bicluster.tests.test_spectral.test_spectral_biclustering: 3.7875s
sklearn.tests.test_common.test_transformers_pickle('MiniBatchDictionaryLearning', <class 'sklearn.decomposition.dict_learning.MiniBatchDictionaryLearning'>, array([...])): 2.0388s
sklearn.tests.test_cross_validation.test_permutation_score: 1.9337s
sklearn.externals.joblib.test.test_parallel.test_pre_dispatch_race_condition: 1.9041s
sklearn.tests.test_cross_validation.test_kfold_can_detect_dependent_samples_on_digits: 1.8517s
sklearn.ensemble.tests.test_bagging.test_classification: 1.7772s
sklearn.externals.joblib.test.test_parallel.test_simple_parallel(None,): 1.7653s
sklearn.externals.joblib.test.test_parallel.test_simple_parallel('multiprocessing',): 1.7573s
sklearn.tests.test_hmm.TestGaussianHMMWithSphericalCovars.test_fit_non_ergodic_transmat: 1.7132s
sklearn.datasets.tests.test_covtype.test_fetch: 1.5588s
sklearn.datasets.tests.test_lfw.test_load_fake_lfw_pairs: 1.5213s
sklearn.externals.joblib.test.test_parallel.test_simple_parallel('threading',): 1.3752s
sklearn.gaussian_process.tests.test_gaussian_process.test_ordinary_kriging: 1.3426s
sklearn.covariance.tests.test_robust_covariance.test_mcd: 1.3305s
sklearn.datasets.tests.test_lfw.test_load_fake_lfw_people: 1.2656s
sklearn.feature_selection.tests.test_rfe.test_rfecv: 1.2065s
sklearn.ensemble.tests.test_forest.test_parallel_train: 1.1865s
sklearn.metrics.tests.test_metrics.test_sample_weight_invariance('samples_roc_auc', functools.partial(<function roc_auc_score at 0x108cbc730>, average='samples'), array([...])): 1.1498s
test_t_sne.test_preserve_trustworthiness_approximately: 1.1080s
sklearn.ensemble.tests.test_gradient_boosting.test_boston: 1.0427s
sklearn.metrics.tests.test_metrics.test_multilabel_representation_invariance: 0.9808s
sklearn.feature_extraction.tests.test_image.test_connect_regions: 0.9732s
sklearn.metrics.tests.test_metrics.test_sample_weight_invariance('samples_average_precision_score', functools.partial(<function average_precision_score at 0x108cbc510>, average='samples'), array([...])): 0.9657s
sklearn.ensemble.tests.test_weight_boosting.test_sparse_regression: 0.9645s
sklearn.ensemble.tests.test_bagging.test_base_estimator: 0.8972s
sklearn.ensemble.tests.test_bagging.test_regression: 0.8699s

@ogrisel ogrisel changed the title from Speed-up test execution to Speed-up test suite execution Jul 16, 2014

Owner

amueller commented Jul 16, 2014

why do we actually run the joblib tests? Can we not rely on the joblib CI?

Owner

GaelVaroquaux commented Jul 16, 2014

why do we actually run the joblib tests?

To have high test coverage number, to keep the spirits of the team high
:)

Owner

amueller commented Jul 16, 2014

Can't we exclude the folder in the coverage? ;)

Owner

GaelVaroquaux commented Jul 16, 2014

Can't we exclude the folder in the coverage? ;)

We could do.

Owner

amueller commented Jul 16, 2014

Actually joblib is not included in the coverage currently ;)

Owner

GaelVaroquaux commented Jul 16, 2014

Actually joblib is not included in the coverage currently ;)

OK, so we can skip the tests, then.

Owner

amueller commented Jul 16, 2014

I couldn't figure out how to make that work :-/

Owner

ogrisel commented Jul 16, 2014

I know how to do it. I will do it in #3403.

Owner

ogrisel commented Feb 27, 2015

Closing this. Many tests have been sped up. We can always improve this but the original report is no longer up to date.

@ogrisel ogrisel closed this Feb 27, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment