Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GeoServer: enable metadata-plugin for modifying layer metadata, including bulk modifications #233

Merged
merged 9 commits into from Aug 12, 2022

Conversation

tlvu
Copy link
Collaborator

@tlvu tlvu commented Jan 25, 2022

See plugin documentation at https://docs.geoserver.org/2.19.x/en/user/community/metadata/index.html

Related to issue Ouranosinc/pavics-sdi#234

Add new "Metadata" tab in Layer Edit page:
Screenshot 2022-01-25 at 00-25-45 GeoServer Edit Layer

@tlvu tlvu requested review from huard and Zeitsperre January 25, 2022 16:46
@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/822/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-225.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/703/

NOTEBOOK TEST RESULTS
    
[2022-01-25T16:58:38.403Z] ============================= test session starts ==============================
[2022-01-25T16:58:38.403Z] platform linux -- Python 3.7.12, pytest-6.2.5, py-1.11.0, pluggy-1.0.0
[2022-01-25T16:58:38.404Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-01-25T16:58:38.404Z] plugins: anyio-3.3.4, dash-2.0.0, nbval-0.9.6, tornasync-0.6.0.post2
[2022-01-25T16:58:38.404Z] collected 238 items
[2022-01-25T16:58:38.404Z] 
[2022-01-25T16:58:46.654Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-01-25T16:59:32.096Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-01-25T16:59:43.276Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 10%]
[2022-01-25T16:59:53.382Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-01-25T16:59:55.807Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-01-25T17:09:59.614Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-01-25T17:10:17.745Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 22%]
[2022-01-25T17:10:54.218Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 24%]
[2022-01-25T17:10:54.791Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 25%]
[2022-01-25T17:11:01.751Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 28%]
[2022-01-25T17:11:09.794Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 30%]
[2022-01-25T17:15:36.465Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 36%]
[2022-01-25T17:16:27.949Z] ..............                                                           [ 42%]
[2022-01-25T17:16:36.510Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 44%]
[2022-01-25T17:16:38.719Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 47%]
[2022-01-25T17:17:07.209Z] .................                                                        [ 54%]
[2022-01-25T17:17:14.795Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 56%]
[2022-01-25T17:17:16.721Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-01-25T17:17:17.780Z] .FFFFFFFF.                                                               [ 61%]
[2022-01-25T17:17:30.678Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-01-25T17:17:40.324Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2022-01-25T17:18:22.606Z] finch-master/docs/source/notebooks/subset.ipynb ....................     [ 76%]
[2022-01-25T17:18:24.542Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 76%]
[2022-01-25T17:18:28.697Z] ......                                                                   [ 79%]
[2022-01-25T17:18:50.665Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 79%]
[2022-01-25T17:19:08.431Z] .............                                                            [ 85%]
[2022-01-25T17:19:18.574Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 85%]
[2022-01-25T17:20:34.975Z] ....s.                                                                   [ 88%]
[2022-01-25T17:20:49.897Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2022-01-25T17:20:57.286Z] ...                                                                      [ 89%]
[2022-01-25T17:21:23.859Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-01-25T17:23:30.815Z] ......                                                                   [ 92%]
[2022-01-25T17:23:34.947Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-01-25T17:27:00.369Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-01-25T17:27:00.370Z] 
[2022-01-25T17:27:00.370Z] =================================== FAILURES ===================================
    
  

Copy link
Collaborator

@huard huard left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok for me but I'll leave the final word to @Zeitsperre.

@tlvu
Copy link
Collaborator Author

tlvu commented Jan 25, 2022

Ok for me but I'll leave the final word to @Zeitsperre.

Yes of course. This is so that I do not have valuable code layout around on my machine and risking to lose it if my disk is corrupted.

I understand we are still in exploratory phase and maybe this plugin do not even do what we need. @Zeitsperre can take as much time as he needs to test this.

@Zeitsperre
Copy link
Contributor

@tlvu Thanks for this. I'll give it a look and see. I think when it comes to streaming metadata, this is likely our only option until the industry advances in adopting the existing metadata standards for geospatial data generally. The goal is to give this all a look this week!

@tlvu
Copy link
Collaborator Author

tlvu commented Mar 16, 2022

@Zeitsperre have you had the time to work on this? Do you still need my test server? See Ouranosinc/pavics-sdi#234 (comment)

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/851/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-69.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/736/

NOTEBOOK TEST RESULTS
    
[2022-03-16T22:42:29.609Z] ============================= test session starts ==============================
[2022-03-16T22:42:29.609Z] platform linux -- Python 3.8.12, pytest-6.2.5, py-1.11.0, pluggy-1.0.0
[2022-03-16T22:42:29.609Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-03-16T22:42:29.609Z] plugins: anyio-3.5.0, dash-2.0.0, nbval-0.9.6, tornasync-0.6.0.post2
[2022-03-16T22:42:29.609Z] collected 244 items
[2022-03-16T22:42:29.609Z] 
[2022-03-16T22:42:37.343Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-03-16T22:43:02.815Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-03-16T22:43:12.898Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-03-16T22:43:20.242Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .FFFFFFF       [ 13%]
[2022-03-16T22:43:23.081Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-03-16T22:45:05.896Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-03-16T22:45:13.495Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-03-16T22:45:28.654Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-03-16T22:45:56.821Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-03-16T22:45:58.207Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-03-16T22:47:08.471Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .FFFFFF            [ 29%]
[2022-03-16T22:47:09.328Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-03-16T22:50:06.571Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-03-16T22:51:09.480Z] ..............                                                           [ 43%]
[2022-03-16T22:51:16.970Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 45%]
[2022-03-16T22:51:18.871Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 48%]
[2022-03-16T22:52:20.628Z] .................                                                        [ 55%]
[2022-03-16T22:52:28.148Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 57%]
[2022-03-16T22:52:30.062Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-03-16T22:52:40.401Z] ..F....FF.                                                               [ 61%]
[2022-03-16T22:52:53.453Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-03-16T22:53:04.021Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2022-03-16T22:53:57.015Z] finch-master/docs/source/notebooks/subset.ipynb .....................    [ 77%]
[2022-03-16T22:53:57.015Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-03-16T22:54:01.223Z] ......                                                                   [ 79%]
[2022-03-16T22:54:19.351Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-03-16T22:54:34.624Z] .............                                                            [ 85%]
[2022-03-16T22:54:42.770Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-03-16T22:55:27.422Z] ....s.                                                                   [ 88%]
[2022-03-16T22:55:37.415Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2022-03-16T22:55:45.249Z] ...                                                                      [ 90%]
[2022-03-16T22:56:03.416Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-03-16T22:56:38.436Z] ......                                                                   [ 93%]
[2022-03-16T22:56:47.981Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-03-16T23:00:07.275Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-03-16T23:00:07.275Z] 
[2022-03-16T23:00:07.275Z] =================================== FAILURES ===================================
    
  

@Zeitsperre
Copy link
Contributor

@Zeitsperre have you had the time to work on this? Do you still need my test server? See Ouranosinc/pavics-sdi#234 (comment)

@tlvu Yes, it would be convenient if you could keep that running. I'll aim to try it out this afternoon if possible!

@tlvu
Copy link
Collaborator Author

tlvu commented Apr 4, 2022

@Zeitsperre have you had the time to work on this? Do you still need my test server? See Ouranosinc/pavics-sdi#234 (comment)

@tlvu Yes, it would be convenient if you could keep that running. I'll aim to try it out this afternoon if possible!

@Zeitsperre Any update?

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/954/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL :

NOTEBOOK TEST RESULTS
    
</code>

@Zeitsperre
Copy link
Contributor

@aulemahal @cjauvin

I know that you two have been working on effective use of GeoServer metadata in the past few months. Do either of you see any benefits from this plugin?

@cjauvin
Copy link
Collaborator

cjauvin commented Jul 21, 2022

It seems interesting but in our context (Portraits climatiques) the metadata have been kept at the NC file level. Maybe there would be a case for transfering them at the GS layer level, if we ever want to expose the WMS service in a more official way?

@Zeitsperre
Copy link
Contributor

@tlvu Let's roll this plugin out. There are some use cases I can see for us even if we can't easily parse the metadata from a WFS/WMS/WCS stream.

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/958/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-10.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/782/

NOTEBOOK TEST RESULTS
    
[2022-08-11T20:17:50.766Z] ============================= test session starts ==============================
[2022-08-11T20:17:50.766Z] platform linux -- Python 3.8.13, pytest-7.1.2, pluggy-1.0.0
[2022-08-11T20:17:50.766Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-08-11T20:17:50.766Z] plugins: anyio-3.5.0, dash-2.3.1, nbval-0.9.6, tornasync-0.6.0.post2
[2022-08-11T20:17:50.766Z] collected 246 items
[2022-08-11T20:17:50.766Z] 
[2022-08-11T20:17:59.451Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-08-11T20:18:48.962Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-08-11T20:18:58.696Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-08-11T20:19:11.136Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-08-11T20:19:13.440Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-08-11T20:20:44.658Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-08-11T20:21:10.645Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-08-11T20:21:28.747Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-08-11T20:21:45.099Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-08-11T20:21:46.487Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-08-11T20:21:51.253Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 29%]
[2022-08-11T20:22:01.390Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-08-11T20:25:46.609Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-08-11T20:26:51.621Z] ..............                                                           [ 43%]
[2022-08-11T20:27:01.117Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 44%]
[2022-08-11T20:27:03.695Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 47%]
[2022-08-11T20:27:34.704Z] .................                                                        [ 54%]
[2022-08-11T20:27:40.854Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 56%]
[2022-08-11T20:27:42.231Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-08-11T20:27:52.263Z] ..F....FF.                                                               [ 61%]
[2022-08-11T20:28:03.364Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-08-11T20:28:12.471Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 67%]
[2022-08-11T20:28:40.089Z] finch-master/docs/source/notebooks/subset.ipynb ....................ss.  [ 77%]
[2022-08-11T20:28:41.463Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-08-11T20:28:44.765Z] ......                                                                   [ 80%]
[2022-08-11T20:28:56.976Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-08-11T20:29:10.112Z] .............                                                            [ 85%]
[2022-08-11T20:29:18.229Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-08-11T20:30:09.826Z] ....s.                                                                   [ 88%]
[2022-08-11T20:30:22.037Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2022-08-11T20:30:27.273Z] ...                                                                      [ 90%]
[2022-08-11T20:30:49.220Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-08-11T20:31:14.575Z] ......                                                                   [ 93%]
[2022-08-11T20:31:19.731Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-08-11T20:34:44.370Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-08-11T20:34:44.370Z] 
[2022-08-11T20:34:44.370Z] =================================== FAILURES ===================================
    
  

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Aug 11, 2022
@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/959/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-10.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/783/

NOTEBOOK TEST RESULTS
    
[2022-08-11T22:37:23.023Z] ============================= test session starts ==============================
[2022-08-11T22:37:23.023Z] platform linux -- Python 3.8.13, pytest-7.1.2, pluggy-1.0.0
[2022-08-11T22:37:23.023Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-08-11T22:37:23.023Z] plugins: anyio-3.5.0, dash-2.3.1, nbval-0.9.6, tornasync-0.6.0.post2
[2022-08-11T22:37:23.023Z] collected 246 items
[2022-08-11T22:37:23.023Z] 
[2022-08-11T22:37:30.873Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-08-11T22:37:56.209Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-08-11T22:38:04.304Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-08-11T22:38:12.800Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-08-11T22:38:15.375Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-08-11T22:39:36.611Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-08-11T22:40:02.111Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-08-11T22:40:17.016Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-08-11T22:40:31.888Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-08-11T22:40:33.271Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-08-11T22:40:38.468Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 29%]
[2022-08-11T22:40:48.430Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-08-11T22:43:42.010Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-08-11T22:44:40.702Z] ..............                                                           [ 43%]
[2022-08-11T22:44:49.092Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 44%]
[2022-08-11T22:44:51.409Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 47%]
[2022-08-11T22:45:18.703Z] .................                                                        [ 54%]
[2022-08-11T22:45:23.215Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 56%]
[2022-08-11T22:45:24.604Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-08-11T22:45:35.007Z] ..F....FF.                                                               [ 61%]
[2022-08-11T22:45:47.103Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-08-11T22:45:56.493Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 67%]
[2022-08-11T22:46:24.995Z] finch-master/docs/source/notebooks/subset.ipynb ....................ss.  [ 77%]
[2022-08-11T22:46:26.382Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-08-11T22:46:29.458Z] ......                                                                   [ 80%]
[2022-08-11T22:46:41.688Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-08-11T22:46:55.892Z] .............                                                            [ 85%]
[2022-08-11T22:47:04.024Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-08-11T22:47:54.515Z] ....s.                                                                   [ 88%]
[2022-08-11T22:48:02.644Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2022-08-11T22:48:07.116Z] ...                                                                      [ 90%]
[2022-08-11T22:48:19.313Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-08-11T22:48:49.114Z] ......                                                                   [ 93%]
[2022-08-11T22:49:02.433Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-08-11T22:52:36.619Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-08-11T22:52:36.620Z] 
[2022-08-11T22:52:36.620Z] =================================== FAILURES ===================================
    
  

This reverts commit ef271f0.

No need to do this, we download the jar at runtime, when the container
starts.
@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/960/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-10.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/784/

NOTEBOOK TEST RESULTS
    
[2022-08-11T23:19:55.463Z] ============================= test session starts ==============================
[2022-08-11T23:19:55.463Z] platform linux -- Python 3.8.13, pytest-7.1.2, pluggy-1.0.0
[2022-08-11T23:19:55.463Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-08-11T23:19:55.463Z] plugins: anyio-3.5.0, dash-2.3.1, nbval-0.9.6, tornasync-0.6.0.post2
[2022-08-11T23:19:55.463Z] collected 246 items
[2022-08-11T23:19:55.463Z] 
[2022-08-11T23:20:04.538Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-08-11T23:20:21.137Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-08-11T23:20:28.896Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-08-11T23:20:35.912Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-08-11T23:20:38.438Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-08-11T23:22:07.163Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-08-11T23:22:20.830Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-08-11T23:22:35.748Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-08-11T23:22:50.841Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-08-11T23:22:52.227Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-08-11T23:22:57.154Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 29%]
[2022-08-11T23:23:04.917Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-08-11T23:25:43.950Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-08-11T23:26:44.812Z] ..............                                                           [ 43%]
[2022-08-11T23:26:49.520Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 44%]
[2022-08-11T23:26:51.735Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 47%]
[2022-08-11T23:27:13.144Z] .................                                                        [ 54%]
[2022-08-11T23:27:19.071Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 56%]
[2022-08-11T23:27:20.457Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-08-11T23:27:30.762Z] ..F....FF.                                                               [ 61%]
[2022-08-11T23:27:42.667Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-08-11T23:27:51.682Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 67%]
[2022-08-11T23:28:18.056Z] finch-master/docs/source/notebooks/subset.ipynb ....................ss.  [ 77%]
[2022-08-11T23:28:19.436Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-08-11T23:28:22.500Z] ......                                                                   [ 80%]
[2022-08-11T23:28:37.403Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-08-11T23:28:48.241Z] .............                                                            [ 85%]
[2022-08-11T23:28:56.360Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-08-11T23:29:50.556Z] ....s.                                                                   [ 88%]
[2022-08-11T23:29:58.682Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2022-08-11T23:30:03.028Z] ...                                                                      [ 90%]
[2022-08-11T23:30:15.227Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-08-11T23:30:45.658Z] ......                                                                   [ 93%]
[2022-08-11T23:30:54.617Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-08-11T23:34:12.408Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-08-11T23:34:12.408Z] 
[2022-08-11T23:34:12.408Z] =================================== FAILURES ===================================
    
  

Altering image on startup is okay only for testing, not for production
deployment.
@github-actions github-actions bot added the ci/operations Continuous Integration components label Aug 12, 2022
@tlvu tlvu merged commit d1ecc63 into master Aug 12, 2022
@tlvu tlvu deleted the enable-metadata-plugin-for-geoserver branch August 12, 2022 00:35
@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/961/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-10.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/785/

NOTEBOOK TEST RESULTS
    
[2022-08-12T00:03:52.983Z] ============================= test session starts ==============================
[2022-08-12T00:03:52.983Z] platform linux -- Python 3.8.13, pytest-7.1.2, pluggy-1.0.0
[2022-08-12T00:03:52.983Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2022-08-12T00:03:52.983Z] plugins: anyio-3.5.0, dash-2.3.1, nbval-0.9.6, tornasync-0.6.0.post2
[2022-08-12T00:03:52.983Z] collected 246 items
[2022-08-12T00:03:52.983Z] 
[2022-08-12T00:04:01.523Z] notebooks-auth/test_thredds.ipynb ...........                            [  4%]
[2022-08-12T00:04:20.111Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [  7%]
[2022-08-12T00:04:28.159Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [  9%]
[2022-08-12T00:04:37.513Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 13%]
[2022-08-12T00:04:40.365Z] pavics-sdi-master/docs/source/notebooks/WPS_example.ipynb ..........     [ 17%]
[2022-08-12T00:05:54.228Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ..........          [ 21%]
[2022-08-12T00:06:07.437Z] pavics-sdi-master/docs/source/notebooks/eccc_geoapi.ipynb .....          [ 23%]
[2022-08-12T00:06:22.360Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .                 [ 23%]
[2022-08-12T00:06:37.241Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 26%]
[2022-08-12T00:06:38.442Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 26%]
[2022-08-12T00:06:43.518Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 29%]
[2022-08-12T00:06:52.380Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 31%]
[2022-08-12T00:09:21.441Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 37%]
[2022-08-12T00:10:31.270Z] ..............                                                           [ 43%]
[2022-08-12T00:10:41.233Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 44%]
[2022-08-12T00:10:43.128Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 47%]
[2022-08-12T00:11:07.863Z] .................                                                        [ 54%]
[2022-08-12T00:11:12.544Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb .....           [ 56%]
[2022-08-12T00:11:13.936Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 57%]
[2022-08-12T00:11:24.608Z] ..F....FF.                                                               [ 61%]
[2022-08-12T00:11:36.546Z] finch-master/docs/source/notebooks/dap_subset.ipynb ..........           [ 65%]
[2022-08-12T00:11:46.776Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 67%]
[2022-08-12T00:12:13.493Z] finch-master/docs/source/notebooks/subset.ipynb ....................ss.  [ 77%]
[2022-08-12T00:12:14.867Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2022-08-12T00:12:18.204Z] ......                                                                   [ 80%]
[2022-08-12T00:12:40.261Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2022-08-12T00:12:54.840Z] .............                                                            [ 85%]
[2022-08-12T00:13:01.404Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2022-08-12T00:13:52.454Z] ....s.                                                                   [ 88%]
[2022-08-12T00:14:00.573Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2022-08-12T00:14:05.503Z] ...                                                                      [ 90%]
[2022-08-12T00:14:17.696Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2022-08-12T00:14:49.250Z] ......                                                                   [ 93%]
[2022-08-12T00:15:00.335Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2022-08-12T00:18:24.951Z] notebooks/stress-tests.ipynb .....                                       [100%]
[2022-08-12T00:18:24.951Z] 
[2022-08-12T00:18:24.951Z] =================================== FAILURES ===================================
    
  

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/962/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL :

NOTEBOOK TEST RESULTS
    
</code>

@crim-jenkins-bot
Copy link
Collaborator

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/963/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : enable-metadata-plugin-for-geoserver
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL :

NOTEBOOK TEST RESULTS
    
</code>

tlvu added a commit that referenced this pull request Jul 12, 2023
…n commit f3b9896

In PR #233, commit d1ecc63 as a
temporary solution only, not needed with newer kartoza docker images.
tlvu added a commit that referenced this pull request Aug 28, 2023
- Delete unused Dockerfiles, fixes #349 and fixes #352

* birdhouse/docker/geoserver: not used since 3-4 years, replaced by
https://github.com/kartoza/docker-geoserver

* birdhouse/config/geoserver/Dockerfile: was introduced in commit
f3b9896 (PR #233, merge commit
d1ecc63) as a temporary solution only,
not needed with newer kartoza docker images.

- Move birdhouse/docker/solr to
birdhouse/deprecated-components/solr/docker to group related files
together. Solr has been deprecated since PR #311 (merge commit
a8d3612).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci/operations Continuous Integration components documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants