Skip to content

Commit

Permalink
Merge pull request #32 from lsst/tickets/DM-28756
Browse files Browse the repository at this point in the history
DM-28756: Create VisitSummary tables for testdata_jointcal
  • Loading branch information
parejkoj committed Feb 19, 2021
2 parents 9739718 + 8d78709 commit c7cb3ec
Show file tree
Hide file tree
Showing 157 changed files with 682 additions and 580 deletions.
4 changes: 2 additions & 2 deletions hsc/01291/HSC-R/output/sourceTable-0034648.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01291/HSC-R/output/sourceTable-0034670.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01291/HSC-R/output/sourceTable-0034674.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01291/HSC-R/output/sourceTable-0034690.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01291/HSC-R/output/sourceTable-0034714.parq
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01291/HSC-R/output/visitSummary-0034648.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01291/HSC-R/output/visitSummary-0034670.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01291/HSC-R/output/visitSummary-0034674.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01291/HSC-R/output/visitSummary-0034690.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01291/HSC-R/output/visitSummary-0034714.fits
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01296/HSC-I/output/sourceTable-0035892.parq
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01296/HSC-I/output/visitSummary-0035892.fits
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01297/HSC-I/output/sourceTable-0036140.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01297/HSC-I/output/sourceTable-0036192.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01297/HSC-I/output/sourceTable-0036236.parq
Git LFS file not shown
4 changes: 2 additions & 2 deletions hsc/01297/HSC-I/output/sourceTable-0036260.parq
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01297/HSC-I/output/visitSummary-0036140.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01297/HSC-I/output/visitSummary-0036192.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01297/HSC-I/output/visitSummary-0036236.fits
Git LFS file not shown
3 changes: 3 additions & 0 deletions hsc/01297/HSC-I/output/visitSummary-0036260.fits
Git LFS file not shown
Git LFS file not shown
1,170 changes: 616 additions & 554 deletions hsc/exports.yaml

Large diffs are not rendered by default.

8 changes: 8 additions & 0 deletions scripts/config/convertRepoHsc.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,10 +9,18 @@
config.runs["calexp"] = testCollection
config.runs["src"] = testCollection
config.runs["sourceTable_visit"] = testCollection
config.runs["visitSummary"] = testCollection
config.runs["src_schema"] = testCollection
config.runs["icSrc_schema"] = testCollection
config.runs["packages"] = extraCollection
config.runs["singleFrameDriver_config"] = extraCollection
config.runs["skyCorr_config"] = extraCollection
config.runs["transformSourceTable_config"] = extraCollection
config.runs["writeSourceTable_config"] = extraCollection

# Default HSC conversion config assumes there are brightObjectMask
# datasets landing in an HSC/masks collection, and then sets the
# option below to include HSC/masks in the HSC/defaults umbrella
# collection. The repo we're converting here has no brightObjectMask
# datasets, so that collection won't exist.
config.extraUmbrellaChildren = []
4 changes: 4 additions & 0 deletions scripts/make_sourcetables_jointcal_hsc_test_data.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,3 +24,7 @@ consolidateSourceTable.py ./hsc --output ./hsc --id visit=34648^34670^34674^3469
# Finally, clean out SRC and sourceTable per-ccd parquet files that we do not need

rm hsc/0????/HSC-?/output/*-???.parq


# Generate consolidated visit summary tables (afw ExposureTable)
consolidateVisitSummary.py ./hsc --output ./hsc --id visit=34648^34670^34674^34690^34714^35892^36140^36192^36236^36260 --no-versions
6 changes: 2 additions & 4 deletions scripts/policy/Source_hsc.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
"""
Configuration file for TransformSourceTableTask which converts source
tables into a DPDD-compatible format.
"""
# Configuration file for TransformSourceTableTask which converts source
# tables into a DPDD-compatible format.
funcs:
sourceId: # the index of deepCoadd_obj IS the objectId
functor: Index
Expand Down

0 comments on commit c7cb3ec

Please sign in to comment.