Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-11639: Initial Sphinx documentation for pipelines.lsst.io #9

Merged
merged 3 commits into from
Aug 28, 2017
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
64 changes: 0 additions & 64 deletions doc/Makefile

This file was deleted.

8 changes: 0 additions & 8 deletions doc/README.md

This file was deleted.

13 changes: 7 additions & 6 deletions doc/index.rst
@@ -1,9 +1,10 @@
.. currentmodule:: lsst.verify.metrics
####################################
verify_metrics documentation preview
####################################

.. _verify_metrics:
Documentation content:

##########################################################
lsst.verify.metrics — Metric and specification definitions
##########################################################
.. toctree::
:maxdepth: 1

TK.
verify_metrics/index
2 changes: 2 additions & 0 deletions doc/manifest.yaml
@@ -0,0 +1,2 @@
# Documentation manifest
package: "verify_metrics"
5 changes: 0 additions & 5 deletions doc/requirements.txt

This file was deleted.

53 changes: 53 additions & 0 deletions doc/verify_metrics/index.rst
@@ -0,0 +1,53 @@
.. _verify-metrics-package:

##############
verify_metrics
##############

``verify_metrics`` provides centralized metric and specification definitions for the LSST Science Pipelines Verification Framework.
The :ref:`lsst.verify <lsst.verify>` module uses these metrics and specifications by default.

For background, see the SQR-017_ (design) and SQR-019_ (demo) technotes.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can these be links?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh nm. I see these are footnotes.


Project info
============

Repository
https://github.com/lsst/verify_metrics

JIRA component
`Verification <https://jira.lsstcorp.org/browse/DM/component/14170>`_.

Contributing
============

Basics
------

- This repository should only contain metric and specification YAML files.
Don't add Python code; instead consider extending the `lsst.verify` API in the :ref:`verify <verify-package>` package.

- Follow `LSST Data Management's workflow <https://developer.lsst.io/processes/workflow.html>`_ for contributions.

Registering metrics
-------------------

**Metrics** are *measureable things*.
They can be astronomy concepts (an astrometric RMS) or computational (a task's timing or memory usage).

Metrics that are measured by packages are **registered** here in ``verify_metrics`` by adding or extending a metric definition YAML file in the ``metrics/`` directory.
See `metrics/README.rst <https://github.com/lsst/verify_metrics/blob/master/metrics/README.rst>`_ for more information.

Registering specifications
--------------------------

**Specifications** are tests of metric measurements.
A specification might say that a metric measurement should be less than a certain value if that measurement was made under a certain set of conditions (*provenance*).
Whenever metrics are measured, DM's SQUASH harness tests those measurements against specifications.
Depending on the pass/fail outcome, subscribers can receive notifications (alerts).

New specifications are **registered** here in ``verify_metrics`` by adding or extending a specification definition YAML file in the ``specs/`` directory.
See `specs/README.rst <https://github.com/lsst/verify_metrics/blob/master/specs/README.rst>`_ for more information.

.. _SQR-017: https://sqr-017.lsst.io
.. _SQR-019: https://sqr-019.lsst.io
2 changes: 1 addition & 1 deletion metrics/README.rst
Expand Up @@ -7,6 +7,6 @@ This directory contains *metric definition* YAML files for each EUPS package tha
Files are named after the EUPS package.
For example: ``validate_drp.yaml`` for the `validate_drp`_ package.

The format of these YAML files is *currently* documented in https://sqr-017.lsst.io/v/DM-9533/index.html#metric-yaml.
The format of these YAML files is *currently* documented in https://sqr-017.lsst.io/index.html#metric-yaml.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are these files to end up in pipelines_lsst_io, and if so, how are they discovered?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@SimonKrughoff, good point. Schema references and user guides for creating new metric and specification YAML definitions will end up in the lsst.verify user guide in pipelines.lsst.io. It'll go there since the format is defined in lsst.verify and verify_metrics just happens to be the default package for declaring metrics and specifications.

We'll deprecate both SQR-017 and SQR-019, which have mostly helped us communicate early development.


.. _validate_drp: https://github.com/lsst/validate_drp
2 changes: 1 addition & 1 deletion specs/README.rst
Expand Up @@ -7,4 +7,4 @@ Specifications are organized into sub-directories, each named after the correspo
For a single package, specifications can be distributed across multiple YAML files and even sub-directories.
The READMEs of each specification sub-directory should state how specifications are organized to suggest where new specifications can be added.

For more information about the format of specification definition YAML files, see https://sqr-017.lsst.io/v/DM-9533/index.html#spec-yaml.
For more information about the format of specification definition YAML files, see https://sqr-017.lsst.io/index.html#spec-yaml.