Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-37729: archive baselineSchema and other obsolete yaml files #106

Merged
merged 4 commits into from
Feb 3, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
35 changes: 11 additions & 24 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,33 +11,20 @@ verification of the catalog outputs from Rubin Observatory science pipelines.

The schemas in this repository serve several different purposes:

* `yml/baselineSchema.yaml` describes the "goal" of the Rubin Observatory
construction project; it is the column-for-column physical description that
corresponds to the abstract schema specified by the Data Products Definition
Document (LSE-163). __Changes to this schema require DM change-control board
approval.__ `baselineSchema.yaml` is used to auto-generate the contents of
LDM-153, which serves as the official reference for the baseline schema.
When proposing changes to the baseline schema, updates may be made to
`baselineSchema.yaml` via normal DM workflow and a new branch of LDM-153
produced, which then requires approval by DM-CCB to become the new project
baseline.
* `yml/imsim.yaml` describes the outputs of the pipelines for LSSTCam-imSim.
It is used to generate the data preview schemas, which are fixed at the time
of their release, while this one will continue to evolve. This schema is
used by `ci_imsim`, which verifies that the schema of the pipeline output
files agree with the contents of this file.

* `yml/imsim.yaml` describes the outputs of the pipelines for LSSTCam-imSim.
It is used to generate the data preview schemas, which are fixed at the time of their release, while this one will continue to evolve.
* The various `dp0X` schemas represent what is actively being served by the
various data previews. These are created from `yml/imsim.yaml` at a
specific point in time.

* `yml/hsc.yaml` describes the outputs of the latest data release production
pipelines. This schema is intended to approximate baselineSchema.yaml, but
with the changes necessary to reflect the current state of the pipelines
(e.g., columns that are not yet computed by the pipelines are removed, some
names differ, and some additional useful columns are added). This schema is
used by `ci_hsc`, which verifies that the schema of the pipeline output files
agree with the contents of this file.

* `yml/sdss_stripe82_01.yml` and `yml/wise_00.yml` describe tables that are
served by the Rubin Observatory Science Platform, even though they are not
produced by the observatory's science pipelines. These files are used to
generate the TAP_SCHEMA records that are required for serving the catalogs
via the IVOA Table Access Protocol (TAP).
pipelines for HyperSuprimeCam. This schema is used by `ci_hsc`, which
verifies that the schema of the pipeline output files agree with the
contents of this file.

Release assets
--------------
Expand Down
9 changes: 0 additions & 9 deletions browser/baseline.md

This file was deleted.

5 changes: 1 addition & 4 deletions browser/hsc.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,5 @@ title: HSC Schema
schema: hsc
sort-index: 20
---
The HSC Schema describes the outputs of the latest data release production pipelines for HyperSuprimeCam. This schema is intended
to approximate the LSST Baseline Schema, but with the changes necessary to reflect the current state of the
pipelines (e.g., columns that are not yet computed by the pipelines are removed, some names differ, and some
additional useful columns are added). This schema is used by [ci_hsc](https://github.com/lsst/ci_hsc), which
The HSC Schema describes the outputs of the latest data release production pipelines for HyperSuprimeCam. This schema is used by [ci_hsc](https://github.com/lsst/ci_hsc), which
verifies the schema of the pipeline output files.
4 changes: 4 additions & 0 deletions yml/archive/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
Archived schemas
================

This directory contains schemas that are no longer in use or are being kept for purely historical reasons as references.
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
---
name: BaselineSchema
"@id": "#baselineSchema"
description: This was the nominal schema defined in the DPDD, but is not up to date with the actual pipeline output. It is kept here as a historical reference.
tables:
- name: ZZZ_Schema_Description
"@id": "#ZZZ_Schema_Description"
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.