Skip to content

Conversation

@ahn1340
Copy link
Contributor

@ahn1340 ahn1340 commented May 16, 2018

When running autosklearn, ensembles will not be built if (1) ensemble_size is set to 0, or (2) if ensemble_builder process fails due to time limit. This causes refit, predict, and predict_proba to fail, and causes fit to fail if ensemble_size is not set to zero. This PR adds ValueError for such situations, along with other minor changes.

@codecov-io
Copy link

codecov-io commented May 16, 2018

Codecov Report

Merging #480 into development will decrease coverage by 0.06%.
The diff coverage is 50%.

Impacted file tree graph

@@               Coverage Diff               @@
##           development     #480      +/-   ##
===============================================
- Coverage         78.6%   78.54%   -0.07%     
===============================================
  Files              130      130              
  Lines            10093    10098       +5     
===============================================
- Hits              7934     7931       -3     
- Misses            2159     2167       +8
Impacted Files Coverage Δ
autosklearn/automl.py 81.18% <50%> (-0.39%) ⬇️
..._preprocessing/select_percentile_classification.py 82.75% <0%> (-6.9%) ⬇️
...osklearn/pipeline/components/classification/lda.py 91.22% <0%> (-3.51%) ⬇️
...ine/components/feature_preprocessing/kernel_pca.py 94.73% <0%> (-1.76%) ⬇️
...e/components/feature_preprocessing/select_rates.py 84.61% <0%> (+3.07%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 013a273...e19b670. Read the comment docs.

@ahn1340 ahn1340 changed the title [WIP] Raise error if ensemble is not built Raise error if ensemble is not built May 17, 2018
@ahn1340
Copy link
Contributor Author

ahn1340 commented May 17, 2018

This should fix #460.

@mfeurer mfeurer merged commit 61a1cd3 into automl:development May 18, 2018
ahn1340 added a commit to ahn1340/auto-sklearn that referenced this pull request May 29, 2018
* .

* .

* AutoSklearnClassifier/Regressor's fit, refit, fit_ensemble now return self.

* Initial commit. Work in Progress.

* Fix minor printing error in sprint_statistics.

* Revert "Fix#460"

* Resolve rebase conflict

* combined unittests to reduce travis runtime

* .

* .

* .

* .

* .
mfeurer pushed a commit that referenced this pull request Nov 9, 2018
* .

* .

* AutoSklearnClassifier/Regressor's fit, refit, fit_ensemble now return self.

* Initial commit. Work in Progress.

* Fix minor printing error in sprint_statistics.

* Revert "Fix#460"

* Raise error if ensemble is not built (#480)

* .

* .

* AutoSklearnClassifier/Regressor's fit, refit, fit_ensemble now return self.

* Initial commit. Work in Progress.

* Fix minor printing error in sprint_statistics.

* Revert "Fix#460"

* Resolve rebase conflict

* combined unittests to reduce travis runtime

* .

* .

* .

* .

* .

* ADD Auto-sklearn 0.4.1 release note to releases.rst
mfeurer pushed a commit that referenced this pull request Dec 6, 2018
* .

* .

* AutoSklearnClassifier/Regressor's fit, refit, fit_ensemble now return self.

* Initial commit. Work in Progress.

* Fix minor printing error in sprint_statistics.

* Revert "Fix#460"

* Raise error if ensemble is not built (#480)

* .

* .

* AutoSklearnClassifier/Regressor's fit, refit, fit_ensemble now return self.

* Initial commit. Work in Progress.

* Fix minor printing error in sprint_statistics.

* Revert "Fix#460"

* Resolve rebase conflict

* combined unittests to reduce travis runtime

* .

* .

* .

* .

* .

* Check target type at the beginning of the fitting process.

* .

* Fixed minor error in uniitest

* .

* Add unittest for target type checking.

* .

* .

* [Debug] try with numpy version 1.14.5

* [Debug] Check if numpy version 1.14.6 raises error.

* Check target type at the beginning of the fitting process.

* .

* Fixed minor error in uniitest

* .

* Add unittest for target type checking.

* .

* .

* [Debug] Check if numpy version 1.14.6 raises error.

* Fix numpy version to 1.14.5

* Add comment to Mock in test_type_of_target

* Fix line length in example_parallel.py

* Fix minor error

* FIX classifier returning prediction larger than 1

* Remove comments

* ADD unittest for ensemble_selection.predict()

* minor FIX

* ADD assertion in predict_proba to check probabilities sum up to 1.

* REVERT changes in autosklearn/ensemble_builder.py

* simplify ensemble prediction method

* Modify assertion statement

* ADD case check in ensemble_selection.predict()

* Fix minor error in pred_probs verficiation.

* Modify unittest for ensemble_selection.predict()

* FIX flake8 errors

* FIX flake8 error

* ADD Ignore assertion for multilabel, check probabilities lie between [0, 1].

* Debug flake8 error
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants