Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DM-11021: Generalize prototype pipeline script #4

Merged
merged 7 commits into from
Aug 11, 2017
Merged

DM-11021: Generalize prototype pipeline script #4

merged 7 commits into from
Aug 11, 2017

Commits on Jul 18, 2017

  1. Update README to point to DMTN-039.

    @mrawls
    mrawls committed Jul 18, 2017
    Configuration menu
    Copy the full SHA
    7157e4c View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2017

  1. Ingest defects as part of doIngestCalibs and update docstrings

    @mrawls
    mrawls committed Jul 28, 2017
    Configuration menu
    Copy the full SHA
    95f24c6 View commit details
    Browse the repository at this point in the history

  2. Refactor decam_process to use verify_ap_hits2015 dataset. 

    Defect ingestion does not work presently because the defects live
in a tar.gz file. Once this is fixed, the pipeline should work.
Additional outstanding issues are noted with TODO in the code.
    @mrawls
    mrawls committed Jul 28, 2017
    Configuration menu
    Copy the full SHA
    282b410 View commit details
    Browse the repository at this point in the history

  3. Use ref_cats from ap_verify_hits2015 dataset 

    Gaia for astrometry, pan-starrs for photometry
These changes effectively complete DM-10975
    @mrawls
    mrawls committed Jul 28, 2017
    Configuration menu
    Copy the full SHA
    b7b5195 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2017

  1. Add control flow, fully retrieve defect files, update comments 

    The defects are now copied and extracted from the input dataset into
the calibrepo, much in the same way ref_cats are extracted into repo.
This is done during ingestion instead of during processing.
    @mrawls
    mrawls committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    9b33a7b View commit details
    Browse the repository at this point in the history

  2. Split main into two functions, reorganize imports, fewer hardwired paths

    @mrawls
    mrawls committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    e46f05c View commit details
    Browse the repository at this point in the history

  3. Each function now returns metadata, plus variable renaming for clarity

    @mrawls
    mrawls committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    bc8f42c View commit details
    Browse the repository at this point in the history