Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DM-21916: SQuaSH upload of Gen 3 Measurements #77

Merged
merged 14 commits into from
Feb 23, 2021
Merged

DM-21916: SQuaSH upload of Gen 3 Measurements #77

merged 14 commits into from
Feb 23, 2021

Commits on Feb 17, 2021

  1. Move jobReporter from faro. 

    The jobReporter script has been moved from the 'tickets/DM-21916-transfer'
branch of lsst-dmsst/metric-pipeline-tasks (soon to be lsst/faro).
    @kfindeisen
    kfindeisen committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    a2c0de2 View commit details
    Browse the repository at this point in the history

  2. Fix imports in make_job_document.py.

    @kfindeisen
    kfindeisen committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    95c2882 View commit details
    Browse the repository at this point in the history

  3. Fix flake8 errors in jobReporter.py. 

    The metric-pipeline-tasks/faro repository used a 110-character limit;
verify uses 80.
    @kfindeisen
    kfindeisen committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    865a4f1 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2021

  1. Merge branch 'tickets/DM-21916-transfer' into tickets/DM-21916

    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    b8a08fd View commit details
    Browse the repository at this point in the history

  2. Move IO code to jobReporter.py. 

    This change allows for less code duplication between make_job_document.py
and a compatibility version in metric-pipeline-tasks/faro.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    fbe6602 View commit details
    Browse the repository at this point in the history

  3. Rename make_job_document to gen3_to_job. 

    This change prevents any name collissions with the compatibility script
in metric-pipeline-tasks, and is less ambiguous in the context of other
lsst.verify scripts.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    5b95b0b View commit details
    Browse the repository at this point in the history

  4. Document job reporter code.

    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    e1d4fd8 View commit details
    Browse the repository at this point in the history

  5. Modernize Sphinx configuration file. 

    This allows package documentation builds with Documenteer 0.6.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    1b3f0bb View commit details
    Browse the repository at this point in the history

  6. Add script documentation for gen3_to_job.py. 

    This change requires moving the script's parser into python.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    5a7d475 View commit details
    Browse the repository at this point in the history

  7. Clarify JobReporter's use of dataset refs.

    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    f303528 View commit details
    Browse the repository at this point in the history

  8. Generalize JobReporter to any data ID format.

    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    59624a0 View commit details
    Browse the repository at this point in the history

  9. Normalize JobReporter filter handling. 

    JobReporter continues to always provide a physical filter, but now only
deduces one if it's not in the data ID.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    4e8e19f View commit details
    Browse the repository at this point in the history

  10. Remove metric-specific defaults from JobReporter. 

    The previous defaults were customized for validate_drp processing. The
alternative CLI in metric-pipeline-tasks/faro keeps the defaults, for
those who want them.
    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    dfa817e View commit details
    Browse the repository at this point in the history

  11. Support butler_generation tag in Gen 2 MetricsControllerTask.

    @kfindeisen
    kfindeisen committed Feb 18, 2021
    Configuration menu
    Copy the full SHA
    bd8d2d4 View commit details
    Browse the repository at this point in the history