From 3b3a33ea6622e6fb9fcf95002ead21884f57503f Mon Sep 17 00:00:00 2001 From: Gregory Dubois-Felsmann Date: Mon, 10 May 2021 12:23:02 -0700 Subject: [PATCH 1/4] Implement new plan for RSP milestones Modified description of LDM-503-14a; added LDM-503-RSPa and LDM-503-RSPb. --- data/local.yaml | 44 ++++++++++++++++++++++++++++++++++++++++---- 1 file changed, 40 insertions(+), 4 deletions(-) diff --git a/data/local.yaml b/data/local.yaml index eb0f576..6ea0bf1 100644 --- a/data/local.yaml +++ b/data/local.yaml @@ -973,12 +973,20 @@ LDM-503-14: jira_testplan: DM-17132 test_spec: '' LDM-503-14a: - description: Take the output of a DRP-like, BG3-based, SDM-ified data production - and, without a great deal of manual labor, make the resulting image and catalog - data available to users through the aspects of the LSP. This includes the generation - of image metadata table content for the LSP. + description: The Rubin Science Platform is ready to support Data Preview 0.1 as + deployed on the IDF. The RSP capabilities are largely those demonstrated under + previous milestones, but ported to the IDF and with deployment and + authentication/authorization infrastructure improvements that support the scale + of DP0.1 usage. The Notebook Aspect provides access to the Rubin Science Pipelines + stack and to data exposed in a cloud-deployed Gen3 Butler repository; the API Aspect + provides TAP queries against a Qserv deployment of catalog tables, but not image + metadata; and the Portal Aspect provides a UI for visual and ADQL construction of + queries against those tables. Image and image metadata access services in the API + and Portal Aspects are not included. jira: DM-26349 jira_testplan: DM-26340 + test_spec: DMTR-301 + short_name: Science Platform ready for DP0.1 LDM-503-15: description: This milestone builds upon LDM-503-13, and will demonstrate the production of a data release under simulated operational conditions using data from science @@ -1038,6 +1046,34 @@ LDM-503-EFDc: jira: DM-26346 jira_testplan: DM-26345 short_name: EFD via TAP +LDM-503-RSPa: + description: The Rubin Science Platform is ready to support Data Preview 0.2 as + deployed on the IDF. The RSP serves an end-to-end Rubin-Gen3-processed dataset + with a substantial set of image and SDM-ified catalog data products. Beyond the + capabilities provided under LDM-503-14a, this deployment provides: initial + IVOA-oriented image metadata and image services in the API Aspect, specifically an + ObsTAP service and a basic SODA-compatible image cutout service; Portal Aspect + support for accessing these services and browsing images from the released dataset; + and access to a User File Workspace from all three Aspects. + jira: DM-30113 + jira_testplan: DM-30112 + short_name: Science Platform ready for DP0.2 with Image Services +LDM-503-RSPb: + description: The Rubin Science Platform is ready to support Science Verification + activities in the final phase of Rubin Observatory commissioning. In additional to + the capabilities demonstrated in Milestone-2 (LDM-503-RSPa), the RSP will: be + scalable to the user load required to support Science Verification; provide access + to a regularly updating stream of newly-acquired LSSTCam data; provide access to + next-to-data computing and user batch computing to support intensive data analysis; + provide access to a User Database Workspace; provide a means for integrating with a + TBD focal-plane-scale visualization tool; provide capabilities in all three Aspects + for following links between related datasets and exploiting provenance information; + provide access to the EFD for recently acquired data, extending the capability + demonstrated for LDM-503-EFDc; and provide substantial user-facing documentation, + with links between the data and documentation. + jira: DM-30117 + jira_testplan: DM-30116 + short_name: Science Platform ready for Science Verification LSST-1510: short_name: Start Early System I&T S19F: From 0b4b0d0a2af5d0275ae4af5652c0a48f56ea395e Mon Sep 17 00:00:00 2001 From: Gregory Dubois-Felsmann Date: Mon, 10 May 2021 12:24:22 -0700 Subject: [PATCH 2/4] Added test report ID for LDM-503-EFDa --- data/local.yaml | 1 + 1 file changed, 1 insertion(+) diff --git a/data/local.yaml b/data/local.yaml index 6ea0bf1..7b5f273 100644 --- a/data/local.yaml +++ b/data/local.yaml @@ -1029,6 +1029,7 @@ LDM-503-EFDa: ability to run for five days, allowing data retrieval and plotting via notebooks. jira: DM-26348 jira_testplan: DM-26342 + test_spec: DMTR-291 short_name: EFD for M1M3 on summit. LDM-503-EFDb: description: Demonstrate that EFD data from the Summit appears at the US Data Facility. From d3c1c9cbadde99dc12e078c8ea458f33da35e2d6 Mon Sep 17 00:00:00 2001 From: Gregory Dubois-Felsmann Date: Mon, 10 May 2021 12:38:56 -0700 Subject: [PATCH 3/4] Escape colons for YAML syntax. --- data/local.yaml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/data/local.yaml b/data/local.yaml index 7b5f273..fff82be 100644 --- a/data/local.yaml +++ b/data/local.yaml @@ -1051,7 +1051,7 @@ LDM-503-RSPa: description: The Rubin Science Platform is ready to support Data Preview 0.2 as deployed on the IDF. The RSP serves an end-to-end Rubin-Gen3-processed dataset with a substantial set of image and SDM-ified catalog data products. Beyond the - capabilities provided under LDM-503-14a, this deployment provides: initial + capabilities provided under LDM-503-14a, this deployment provides:: initial IVOA-oriented image metadata and image services in the API Aspect, specifically an ObsTAP service and a basic SODA-compatible image cutout service; Portal Aspect support for accessing these services and browsing images from the released dataset; @@ -1062,7 +1062,7 @@ LDM-503-RSPa: LDM-503-RSPb: description: The Rubin Science Platform is ready to support Science Verification activities in the final phase of Rubin Observatory commissioning. In additional to - the capabilities demonstrated in Milestone-2 (LDM-503-RSPa), the RSP will: be + the capabilities demonstrated in Milestone-2 (LDM-503-RSPa), the RSP will:: be scalable to the user load required to support Science Verification; provide access to a regularly updating stream of newly-acquired LSSTCam data; provide access to next-to-data computing and user batch computing to support intensive data analysis; From 7a7e5cc85b12eb6c5a13a4cc90c60fc167aaafbe Mon Sep 17 00:00:00 2001 From: Gregory Dubois-Felsmann Date: Mon, 10 May 2021 12:42:08 -0700 Subject: [PATCH 4/4] Quote strings containing colons. --- data/local.yaml | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/data/local.yaml b/data/local.yaml index fff82be..af6223b 100644 --- a/data/local.yaml +++ b/data/local.yaml @@ -1048,21 +1048,21 @@ LDM-503-EFDc: jira_testplan: DM-26345 short_name: EFD via TAP LDM-503-RSPa: - description: The Rubin Science Platform is ready to support Data Preview 0.2 as + description: 'The Rubin Science Platform is ready to support Data Preview 0.2 as deployed on the IDF. The RSP serves an end-to-end Rubin-Gen3-processed dataset with a substantial set of image and SDM-ified catalog data products. Beyond the - capabilities provided under LDM-503-14a, this deployment provides:: initial + capabilities provided under LDM-503-14a, this deployment provides: initial IVOA-oriented image metadata and image services in the API Aspect, specifically an ObsTAP service and a basic SODA-compatible image cutout service; Portal Aspect support for accessing these services and browsing images from the released dataset; - and access to a User File Workspace from all three Aspects. + and access to a User File Workspace from all three Aspects.' jira: DM-30113 jira_testplan: DM-30112 short_name: Science Platform ready for DP0.2 with Image Services LDM-503-RSPb: - description: The Rubin Science Platform is ready to support Science Verification + description: 'The Rubin Science Platform is ready to support Science Verification activities in the final phase of Rubin Observatory commissioning. In additional to - the capabilities demonstrated in Milestone-2 (LDM-503-RSPa), the RSP will:: be + the capabilities demonstrated in Milestone-2 (LDM-503-RSPa), the RSP will be scalable to the user load required to support Science Verification; provide access to a regularly updating stream of newly-acquired LSSTCam data; provide access to next-to-data computing and user batch computing to support intensive data analysis; @@ -1071,7 +1071,7 @@ LDM-503-RSPb: for following links between related datasets and exploiting provenance information; provide access to the EFD for recently acquired data, extending the capability demonstrated for LDM-503-EFDc; and provide substantial user-facing documentation, - with links between the data and documentation. + with links between the data and documentation.' jira: DM-30117 jira_testplan: DM-30116 short_name: Science Platform ready for Science Verification