Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

finch: new release for dask performance problem #243

Merged
merged 2 commits into from
Apr 21, 2022

Conversation

tlvu
Copy link
Collaborator

@tlvu tlvu commented Apr 21, 2022

PR to deploy new Finch releases in bird-house/finch#233 on PAVICS.

See the Finch PR for more info.

Finch release notes:

0.8.3 (2022-04-21)

PR to deploy new Finch releases in
bird-house/finch#233 on PAVICS.

See the Finch PR for more info.

Finch release notes:

0.8.3 (2022-04-21)
------------------
* Preserve RCP dimension in ensemble processes, even when only RCP
is selected.

* Pin ``dask`` and ``distributed`` at ``2022.1.0``, see
Ouranosinc/PAVICS-e2e-workflow-tests#100
@tlvu tlvu requested a review from tlogan2000 April 21, 2022 15:57
Copy link
Collaborator

@tlogan2000 tlogan2000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Assuming jenkins e2e passes things look good to me

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/867/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : new-finch-for-dask-performance-fix
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-227.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/749/

NOTEBOOK TEST RESULTS
    
[2022-04-21T16:11:44.665Z] ============================= test session starts ==============================
[2022-04-21T16:11:44.665Z] platform linux -- Python 3.8.13, pytest-7.1.1, pluggy-1.0.0
[2022-04-21T16:11:44.665Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-04-21T16:11:44.665Z] plugins: anyio-3.5.0, dash-2.3.1, nbval-0.9.6, tornasync-0.6.0.post2
[2022-04-21T16:11:44.665Z] collected 244 items
[2022-04-21T16:11:44.665Z] 
[2022-04-21T16:11:52.251Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-04-21T16:13:01.304Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-04-21T16:13:12.027Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-04-21T16:13:20.925Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-04-21T16:13:24.073Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-04-21T16:14:56.416Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-04-21T16:15:21.127Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-04-21T16:15:39.224Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-04-21T16:16:02.657Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-04-21T16:16:03.231Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-04-21T16:16:09.220Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 29%]
[2022-04-21T16:16:17.744Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-04-21T16:20:02.188Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-04-21T16:21:09.582Z] ..............                                                           [ 43%]
[2022-04-21T16:21:23.267Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 45%]
[2022-04-21T16:21:25.052Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 48%]
[2022-04-21T16:21:49.800Z] .................                                                        [ 55%]
[2022-04-21T16:21:57.562Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 57%]
[2022-04-21T16:21:58.948Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-04-21T16:22:09.848Z] ..F....FF.                                                               [ 61%]
[2022-04-21T16:22:22.444Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-04-21T16:22:32.334Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2022-04-21T16:23:25.318Z] finch-master/docs/source/notebooks/subset.ipynb .....................    [ 77%]
[2022-04-21T16:23:27.237Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-04-21T16:23:30.790Z] ......                                                                   [ 79%]
[2022-04-21T16:23:52.746Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-04-21T16:24:06.819Z] .............                                                            [ 85%]
[2022-04-21T16:24:14.956Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-04-21T16:25:00.826Z] ....s.                                                                   [ 88%]
[2022-04-21T16:25:15.725Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2022-04-21T16:25:22.674Z] ...                                                                      [ 90%]
[2022-04-21T16:25:44.659Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-04-21T16:26:19.962Z] ......                                                                   [ 93%]
[2022-04-21T16:26:25.781Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-04-21T16:29:45.399Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-04-21T16:29:45.399Z] 
[2022-04-21T16:29:45.399Z] =================================== FAILURES ===================================
    
  

@tlvu
Copy link
Collaborator Author

tlvu commented Apr 21, 2022

Assuming jenkins e2e passes things look good to me

Yes, and in prod :) This problem did not happen on our staging and test server.

@github-actions github-actions bot added ci/operations Continuous Integration components documentation Improvements or additions to documentation labels Apr 21, 2022
@tlvu tlvu merged commit c3b2cbc into master Apr 21, 2022
@tlvu tlvu deleted the new-finch-for-dask-performance-fix branch April 21, 2022 21:37
@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/868/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : new-finch-for-dask-performance-fix
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL :

NOTEBOOK TEST RESULTS
    
</code>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci/operations Continuous Integration components documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants