Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workflow - Build Conda Package #1870

Merged
merged 49 commits into from
Apr 16, 2021
Merged

Workflow - Build Conda Package #1870

merged 49 commits into from
Apr 16, 2021

Conversation

ParthivNaresh
Copy link
Contributor

Fixes #1824

@ParthivNaresh ParthivNaresh self-assigned this Feb 22, 2021
@codecov
Copy link

codecov bot commented Feb 22, 2021

Codecov Report

Merging #1870 (348f57a) into main (16c30b8) will increase coverage by 9.8%.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff            @@
##            main    #1870     +/-   ##
========================================
+ Coverage   90.2%   100.0%   +9.8%     
========================================
  Files        293      293             
  Lines      23915    23915             
========================================
+ Hits       21570    23905   +2335     
+ Misses      2345       10   -2335     
Impacted Files Coverage Δ
evalml/automl/automl_search.py 100.0% <0.0%> (+0.4%) ⬆️
...s/prediction_explanations_tests/test_algorithms.py 100.0% <0.0%> (+1.1%) ⬆️
evalml/tests/component_tests/test_components.py 100.0% <0.0%> (+1.5%) ⬆️
evalml/tests/pipeline_tests/test_pipeline_utils.py 100.0% <0.0%> (+1.9%) ⬆️
evalml/tests/pipeline_tests/test_pipelines.py 100.0% <0.0%> (+2.6%) ⬆️
...derstanding/prediction_explanations/_algorithms.py 97.8% <0.0%> (+3.4%) ⬆️
evalml/tests/component_tests/test_utils.py 100.0% <0.0%> (+3.6%) ⬆️
evalml/tests/utils_tests/test_dependencies.py 85.8% <0.0%> (+4.8%) ⬆️
evalml/pipelines/component_graph.py 100.0% <0.0%> (+6.7%) ⬆️
.../automl_tests/test_automl_search_classification.py 100.0% <0.0%> (+9.0%) ⬆️
... and 34 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 16c30b8...348f57a. Read the comment docs.

@ParthivNaresh ParthivNaresh marked this pull request as draft February 23, 2021 20:58
@ParthivNaresh ParthivNaresh marked this pull request as ready for review April 15, 2021 00:27
@@ -23,7 +23,7 @@ scikit-optimize==0.8.1
scipy==1.6.2
seaborn==0.11.1
shap==0.39.0
sktime==0.5.3
sktime==0.6.0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this dependency change for this PR?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oo this was for the dependency test right? I just merged in the PR so this isn't needed anymore 😄

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No this was unrelated but needed to pass the dependency check, sktime had a release a few hours ago and it doesn't break any of our code but I thought I should include it for bug fixes etc.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

^^Ignore this haha I didn't see your next comment

Copy link
Contributor

@freddyaboulton freddyaboulton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ParthivNaresh I think this looks good!

name: Build Conda Package

on:
pull_request:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we only want this to run on pushes to main

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@freddyaboulton Currently build_conda_pkg runs in CircleCI as part of the other workflows, so on every commit, primarily for the shellcheck. Are we changing this behaviour @dsherry ?

Copy link
Contributor

@freddyaboulton freddyaboulton Apr 15, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I think I missed if: github.ref == 'refs/head/main' line below. If that means that the package is only built on commits to main, then I think we're good to go!

But I think we can make it simpler by only using

on: 
push: 
branches: 
 -main

I don't think we need the shellcheck to run on PR branches but let me know if I'm misunderstanding!

Copy link
Contributor Author

@ParthivNaresh ParthivNaresh Apr 15, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it, I was under the impression we were keeping the same behaviour as the CircleCI implementation but if we're good to not do a shellcheck on PR branches then I can definitely make the change to only run on main. I agree that I don't think it's necessary to have it run on PRs.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good to me!

I also wonder if shellcheck would belong better in our lint jobs.

Copy link
Contributor

@dsherry dsherry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! One minor change requested, to prove that the action is green

username: $DOCKERHUB_USERNAME
password: $DOCKERHUB_PASSWORD
environment:
OMP_NUM_THREADS: 8
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ParthivNaresh @freddyaboulton I see our old config was setting OMP_NUM_THREADS here. I believe this config was being applied for all our circleci jobs. I am wondering if we should continue to set this in our GH actions.

@@ -1,101 +0,0 @@
version: 2.1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👋 🚽 🌪️ 😆

.github/workflows/build_conda_pkg.yml Show resolved Hide resolved
Copy link
Contributor

@angela97lin angela97lin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Goooodbye codecov!! LGTM 🥂

Copy link
Contributor

@dsherry dsherry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢 😁

.github/workflows/build_conda_pkg.yml Show resolved Hide resolved
@dsherry dsherry merged commit 4d86b60 into main Apr 16, 2021
chukarsten added a commit that referenced this pull request Apr 20, 2021
…skEngine`` #1975.

- Added optional ``engine`` argument to ``AutoMLSearch`` #1975
- Added a warning about how time series support is still in beta when a user passes in a time series problem to ``AutoMLSearch`` #2118
- Added ``NaturalLanguageNaNDataCheck`` data check #2122
- Added ValueError to ``partial_dependence`` to prevent users from computing partial dependence on columns with all NaNs #2120
- Added standard deviation of cv scores to rankings table #2154
- Fixed ``BalancedClassificationDataCVSplit``, ``BalancedClassificationDataTVSplit``, and ``BalancedClassificationSampler`` to use ``minority:majority`` ratio instead of ``majority:minority`` #2077
- Fixed bug where two-way partial dependence plots with categorical variables were not working correctly #2117
- Fixed bug where ``hyperparameters`` were not displaying properly for pipelines with a list ``component_graph`` and duplicate components #2133
- Fixed bug where ``pipeline_parameters`` argument in ``AutoMLSearch`` was not applied to pipelines passed in as ``allowed_pipelines`` #2133
- Fixed bug where ``AutoMLSearch`` was not applying custom hyperparameters to pipelines with a list ``component_graph`` and duplicate components #2133
- Removed ``hyperparameter_ranges`` from Undersampler and renamed ``balanced_ratio`` to ``sampling_ratio`` for samplers #2113
- Renamed ``TARGET_BINARY_NOT_TWO_EXAMPLES_PER_CLASS`` data check message code to ``TARGET_MULTICLASS_NOT_TWO_EXAMPLES_PER_CLASS`` #2126
- Modified one-way partial dependence plots of categorical features to display data with a bar plot #2117
- Renamed ``score`` column for ``automl.rankings`` as ``mean_cv_score`` #2135
- Fixed ``conf.py`` file #2112
- Added a sentence to the automl user guide stating that our support for time series problems is still in beta. #2118
- Fixed documentation demos #2139
- Update test badge in README to use GitHub Actions #2150
- Fixed ``test_describe_pipeline`` for ``pandas`` ``v1.2.4`` #2129
- Added a GitHub Action for building the conda package #1870 #2148
.. warning::
- Renamed ``balanced_ratio`` to ``sampling_ratio`` for the ``BalancedClassificationDataCVSplit``, ``BalancedClassificationDataTVSplit``, ``BalancedClassficationSampler``, and Undersampler #2113
- Deleted the "errors" key from automl results #1975
- Deleted the ``raise_and_save_error_callback`` and the ``log_and_save_error_callback`` #1975
- Fixed ``BalancedClassificationDataCVSplit``, ``BalancedClassificationDataTVSplit``, and ``BalancedClassificationSampler`` to use minority:majority ratio instead of majority:minority #2077
@chukarsten chukarsten mentioned this pull request Apr 20, 2021
@freddyaboulton freddyaboulton deleted the 1824-Build-Conda-Package branch May 13, 2022 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GitHub Actions - Workflow - build_conda_pkg
6 participants