Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] tests for check_estimator tests passing #2408

Merged
merged 6 commits into from Apr 9, 2022
Merged

Conversation

fkiraly
Copy link
Collaborator

@fkiraly fkiraly commented Apr 7, 2022

This PR adds tests to test that tests conducted by the check_estimator utlity are passing, on three example estimators that are known to pass all tests in the full test suite.

This ensures that future tests catch unintentional side effects to changes in the test module that cause a check_estimator test to fail, such as the problem addressed recently in #2405

Also turns some instances of pytest.skip inside tests into return None, as that currently breaks check_estimator. An issue to replace this workaroudn has been opened here: #2419

@fkiraly fkiraly added the module:tests test framework functionality - only framework, excl specific tests label Apr 7, 2022
@fkiraly fkiraly added this to In progress - testing module in Workstream: docs, maintenance, testing Apr 7, 2022
@fkiraly fkiraly merged commit 84f7955 into main Apr 9, 2022
@fkiraly fkiraly deleted the test-check_estimator branch April 9, 2022 11:50
@lmmentel lmmentel added the maintenance Continuous integration, unit testing & package distribution label Apr 9, 2022
srggrs added a commit to Gridsight/sktime that referenced this pull request Apr 11, 2022
* upstream/main: (34 commits)
  Update codecov uploader from deprecated version and cosmetic improvements of CI scripts. (sktime#2389)
  bump version (sktime#2445)
  Fix typo in PULL_REQUEST_TEMPLATE.md (sktime#2446)
  [BUG] Incorrect indices returned by make_reduction on hierarchical data fixed (sktime#2438)
  [BUG] fix erroneous direct passthrough in ColumnEnsembleForecaster (sktime#2436)
  [BUG] forecasting pipeline dunder fix (sktime#2431)
  [BUG] temp workaround for unnamed levels in hierarchical X passed to aggregator (sktime#2432)
  Release v0.11.1 (sktime#2428)
  [ENH] extending reducers to hierarchical data, add transform-on-y functionality (sktime#2396)
  [ENH] interface to statsmodels SARIMAX interface (sktime#2400)
  [BUG] fixed fitting logic for postprocessing in `TransformedTargetForecaster` (sktime#2426)
  [BUG] `TransformedTargetForecaster` inverses were not working for univariate transformers and more than one quantile (sktime#2425)
  [BUG] fixing proba predict methods of forecasting tuning estimators (sktime#2423)
  [ENH] suppressing deprecation messages in `all_estimators` estimator retrieval, address `dtw` import message (sktime#2418)
  [BUG] fixed `score_average` parameter of proba metrics, docstrings (sktime#2401)
  [BUG] Sets "can handle missing value" tag in ARIMA and AutoARIMA (sktime#2420)
  [ENH] tests for `check_estimator` tests passing (sktime#2408)
  [ENH] post-processing in `TransformedTargetForecaster`, dunder method for (transformed `y`) forecasting pipelines (sktime#2404)
  [ENH] extend `_HeterogeneousMetaEstimator` estimator to allow mixed tuple/estimator list (sktime#2406)
  [BUG] fixed get_time_index for most mtypes (sktime#2380)
  ...
@fkiraly fkiraly moved this from In progress - testing module to Done in Workstream: docs, maintenance, testing Nov 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintenance Continuous integration, unit testing & package distribution module:tests test framework functionality - only framework, excl specific tests
Development

Successfully merging this pull request may close these issues.

None yet

2 participants