Skip to content

Commit

Permalink
Merge pull request #50 from desihub/ql_JuneUpdates
Browse files Browse the repository at this point in the history 
ql June updates
  • Loading branch information
@sbailey
sbailey committed Jun 28, 2018
2 parents d7b9f47 + 27d755f commit 1ed85bd
Show file tree
Hide file tree
Showing 13 changed files with 461 additions and 415 deletions.
1 change: 1 addition & 0 deletions doc/QUICKLOOK/index.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ QUICKLOOK
$ql-countbins-{camera}-{expid}.json : QA output counting bins in spectrum above thresholds <ql-countbins-CAMERA-EXPID>
$ql-skycont-{camera}-{expid}.json : QA output from sky continuum calculation <ql-skycont-CAMERA-EXPID>
$ql-skypeak-{camera}-{expid}.json : QA output calculating statistics at peak sky wavelengths <ql-skypeak-CAMERA-EXPID>
$ql-skyRband-{camera}-{expid}.json : QA output comparing skyflux in Rband with that of the skymonitor <ql-skyRband-CAMERA-EXPID>
$ql-skyresid-{camera}-{expid}.json : QA Residuals for sky fibers after subtraction <ql-skyresid-CAMERA-EXPID>
$ql-integ-{camera}-{expid}.json : QA output calculating total counts for standard stars <ql-integ-CAMERA-EXPID>
$ql-snr-{camera}-{expid}.json : QA output for the signal to noise calculation after sky subtraction <ql-snr-CAMERA-EXPID>
Expand Down
5 changes: 2 additions & 3 deletions doc/QUICKLOOK/ql-checkHDUs-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ KEY Example Value Type Comment
CAMERA b4 string b0-9, r0-r9, z0-z9
EXPID 00003900 int Exposure ID
FLAVOR science string The type of exposure that can flat, arc or science
PANAME SkySub_QL string Name of pipeline algorihm
PANAME Initialize string Name of pipeline algorihm
QATIME 2018-05-27T float Timestamp (UTC) of time of QA execution
11:35:46.0285
NIGHT 20191017 int The night of observation
Expand Down Expand Up @@ -77,6 +77,5 @@ Example JSON Output
"SEEING": 1.1
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:31:29.246245",
"QA_STATUS": "UNKNOWN"
"QATIME": "2018-05-27T11:31:29.246245"
}
9 changes: 4 additions & 5 deletions doc/QUICKLOOK/ql-countbins-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ PROGRAM dark string name of the observing program: da

NGOODFIB 500 int number of fibers with a nonzero number of bins above highest threshold
N_KNOWN_BROKEN_FIBERS 0 int number od known broken fibers
NGOODFIB_STATUS "ALARM" string
NGOODFIB_STATUS "NORMAL" string
===================== ============= ========== ============================================================

Example JSON Output
Expand All @@ -71,7 +71,7 @@ Example JSON Output
"GOOD_FIBER": [500
]
"NGOODFIB": 500,
"NGOODFIB_STATUS": "ALARM"
"NGOODFIB_STATUS": "NORMAL"
},
"NIGHT": "20191017",
"PANAME": "BoxcarExtract",
Expand All @@ -81,14 +81,13 @@ Example JSON Output
-1,
1
],
"NGOODFIB_REF": 0,
"NGOODFIB_REF": 500,
"NGOODFIB_WARN_RANGE": [
-2,
2
],
"N_KNOWN_BROKEN_FIBERS": 0
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:33:21.646358",
"QA_STATUS": "UNKNOWN"
"QATIME": "2018-05-27T11:33:21.646358"
}
17 changes: 8 additions & 9 deletions doc/QUICKLOOK/ql-countpix-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,14 +46,14 @@ KEY Example Value Type Comment
CAMERA b4 string b0-9, r0-r9, z0-z9
EXPID 00003900 int Exposure ID
FLAVOR science string The type of exposure that can flat, arc or science
PANAME BoxcarExtract string Name of pipeline algorihm
PANAME Preproc string Name of pipeline algorihm
QATIME 2018-05-27T float Timestamp (UTC) of time of QA execution
11:33:21.6463
NIGHT 20191017 int The night of observation

PROGRAM dark string name of the observing program: dark, grey, bright
LITFRAC_AMP [0.35,...] float[4] Fraction of the pixels per amp that are above CUTPIX = 5sigmas
LITFRAC_STATUS ALARM string Reports the status of LITFRAC_AMP
LITFRAC_STATUS NORMAL string Reports the status of LITFRAC_AMP
================ ============= ========== ==================================================

Example JSON Output
Expand All @@ -72,17 +72,17 @@ Example JSON Output
0.4,
0.37
],
"LITFRAC_STATUS": "ALARM"
"LITFRAC_STATUS": "NORMAL"
},
"NIGHT": "20191017",
"PANAME": "Preproc",
"PARAMS": {
"CUTPIX": 5,
"LITFRAC_AMP_REF": [
0.0,
0.0,
0.0,
0.0
0.35,
0.36,
0.32,
0.33
],
"LITFRAC_NORMAL_RANGE": [
-0.1,
Expand All @@ -94,6 +94,5 @@ Example JSON Output
]
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:31:44.047383",
"QA_STATUS": "UNKNOWN"
"QATIME": "2018-05-27T11:31:44.047383"
}
13 changes: 6 additions & 7 deletions doc/QUICKLOOK/ql-getbias-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ PROGRAM dark string name of the observing program: dark, g

BIAS 147.041, float value of bias across image
BIAS_AMP 4 float[4] value of bias averaged over each amplifier
BIAS_STATUS ALARM string status of BIAS_AMP
BIAS_STATUS NORMAL string status of BIAS_AMP
================ ============= ========== ==============================================

Example JSON Output
Expand All @@ -81,10 +81,10 @@ Example JSON Output
"PANAME": "Preproc",
"PARAMS": {
"BIAS_AMP_REF": [
0.0,
0.0,
0.0,
0.0
166.859,
150.606,
155.208,
115.488
],
"BIAS_NORMAL_RANGE": [
-1.0,
Expand All @@ -99,6 +99,5 @@ Example JSON Output
"PROC_QuickLook_VERSION": "05.18.0"
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:31:42.766594",
"QA_STATUS": "UNKNOWN"
"QATIME": "2018-05-27T11:31:42.766594"
}
14 changes: 8 additions & 6 deletions doc/QUICKLOOK/ql-getrms-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,9 @@ NOISE_AMP 4 float[4] value of RMS for each amplifier read
NOISE_OVERSCAN_AMP 4 float[4] value of RMS of the onerscan region per amplifier read directly from the header of the preproc image
BIAS_PATNOISE 4 float[4] rms of the row by row bias difference divided by the noise of that amp
NOISE_STATUS ALARM string status of NOISE_AMP
DATA5SIG 1 float number of pixels more than 5 sigma below bias in data region of CCD (BOSS)
DIFF1SIG 0.045 float difference between 1 sigma low and high percentile bounds
DIFF2SIG 0.129 float difference between 2 sigma low and high percentile bounds
================== ============= ========== ==================================================

Example JSON Output
Expand Down Expand Up @@ -92,16 +95,16 @@ Example JSON Output
2.032141125973641,
2.121880270752116
],
"NOISE_STATUS": "ALARM"
"NOISE_STATUS": "NORMAL"
},
"NIGHT": "20191017",
"PANAME": "Preproc",
"PARAMS": {
"NOISE_AMP_REF": [
0.0,
0.0,
0.0,
0.0
1.3184224194929928,
1.390981338461623,
2.078279428799927,
1.6012346133106736
],
"NOISE_NORMAL_RANGE": [
-1.0,
Expand All @@ -119,5 +122,4 @@ Example JSON Output
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:31:43.342882",
"QA_STATUS": "UNKNOWN"
}
40 changes: 21 additions & 19 deletions doc/QUICKLOOK/ql-integ-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ DEC [21.97,...] float[500] List of declinations for all the 500 t
STD_FIBERID [11, 63,...] int[NS] List of the fiber IDs assigned to NS standard stars
DELTAMAG [0.,0.,...] float[500] List of mag diff b/w the fibermag and the imaging mag from the fibermap
DELTAMAG_TGT [-2.92,...] float[N] List of the average fiber mag for each of N target types in this camera
DELTAMAG_STATUS ALARM string Status of DELTAMAG_TGT
DELTAMAG_STATUS NORMAL string Status of DELTAMAG_TGT
================ ============= ========== ==============================================

Example JSON Output
Expand All @@ -80,25 +80,28 @@ Example JSON Output
21.927311569249582
],
"DELTAMAG": [
0.0,
0.0,
0.0,
0.0,
3.0353081235137225,
3.403078925212945,
2.5281561278539044,
1.7672550687206403,
...,
0.0,
0.0
2.5318920110836416,
3.419798185738788
],
"DELTAMAG_STATUS": "ALARM",
"DELTAMAG_STATUS": "NORMAL",
"DELTAMAG_TGT": [
-2.9209345331080705,
NaN,
-0.9617997285914122,
-4.5797822546440585
2.9209345331080705,
2.5172154402224542,
0.9617997285914122,
4.5797822546440585
],
"FIBER_MAG": [
18.22211846792697,
18.294963907355225,
21.828487269112493
21.828487269112493,
...,
24.524279782690087,
25.031647016915546
],
"RA": [
266.4916642633111,
Expand Down Expand Up @@ -133,17 +136,16 @@ Example JSON Output
0.5
],
"DELTAMAG_TGT_REF": [
0.0,
0.0,
0.0,
0.0
2.9209345331080705,
2.5172154402224542,
0.9617997285914122,
4.5797822546440585
],
"DELTAMAG_WARN_RANGE": [
-1.0,
1.0
]
},
"PROGRAM": "dark",
"QATIME": "2018-05-27T11:35:46.028467",
"QA_STATUS": "UNKNOWN"
"QATIME": "2018-05-27T11:35:46.028467"
}
44 changes: 22 additions & 22 deletions doc/QUICKLOOK/ql-mergedQA-CAMERA-EXPID.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ Dictionary Contents

KEYNAME = mergedQA

Sky residuals calculations over each sky fiber and averaged over sky fibers.
SKY residuals calculations over each sky fiber and averaged over sky fibers.


Keyword Description
Expand All @@ -54,7 +54,7 @@ AIRMASS 1.0 float From the header of t
ELG_FIBERID 331 int[ne] From the fibermap, ne is number of ELGs
LRG_FIBERID 65 int[nl] From the fibermap, nl is number of LRGs
QSO_FIBERID 56 int[nq] From the fibermap, nq is number of QSOs
SKY_FIBERID 37 int[nsky] From the fibermap, nsky is number of Sky fibers
SKY_FIBERID 37 int[nsky] From the fibermap, nsky is number of SKY fibers
STAR_FIBERID 11 int[ns] From the fibermap, nsky is number STARs
IMAGING_MAGS 500, 3 float[500,3] From the fibermap [DECAM_G, DECAM_R, DECAM_Z]
RA 500 float[500] Right ascention of all the 500 targets
Expand All @@ -81,72 +81,72 @@ HDU_STATUS NORMAL string Reports the result o
CHECK CCDs KEY Example Value Type Comment
======================= ================= ================ ===================================================
BIAS_AMP 4 float[4] value of bias averaged over each amplifier
BIAS_STATUS ALARM string Reports the status of BIAS_AMP
BIAS_STATUS NORMAL string Reports the status of BIAS_AMP
BIAS_PATNOISE 4 float[4] rms of the row by row bias difference divided by the noise of
that amp
DATA5SIG 1 int Number of pixels with counts 5sigma below bias in region of CCD
DIFF1SIG 0.032 float Diff. between 1 sigma low and high percentile bounds
DIFF2SIG 0.057 float Diff. between 2 sigma low and high percentile bounds
LITFRAC_AMP 4 float[4] Fraction of the pixels per amp that are above CUTPIX = 5sigmas
LITFRAC_STATUS ALARM string Reports the status of LITFRAC_AMP
LITFRAC_STATUS NORMAL string Reports the status of LITFRAC_AMP
NOISE_AMP 4 float[4] value of RMS per amp read directly from the header of the
preproc image
NOISE_OVERSCAN_AMP 4 float[4] value of RMS of the onerscan region per amp read directly from
the header of the preproc image
NOISE_STATUS ALARM string Reports the status pf NOISE_AMP
NOISE_STATUS NORMAL string Reports the status pf NOISE_AMP
======================= ================= ================ ===================================================

======================= ================= ================ ===================================================
CHECK FIBERS KEY Example Value Type Comment
======================= ================= ================ ===================================================

XWSIGMA_FIB 2,500 float[500,2] median of XSIGMAs for all fibers per amp
GOOD_FIBER 500 boolean List of boolians for good[1] and bad[0] fibers
NGOODFIB <=500 int Number of good fibers
NGOODFIB_STATUS ALARM string Reports the status of NGOODFIB
XWSIGMA 2 float List of median X and W sigmas
NGOODFIB N int Number of good fibers
NGOODFIB_STATUS NORMAL string Reports the status of NGOODFIB
XWSIGMA 2 float[2] List of median X and W sigmas
XWSIGMA_AMP 4,2 float[4,2] List of four [X,W]sigmas
XWSIGMA_STATUS ALARM string Reports the status of XWSIGMA
XWSIGMA_STATUS NORMAL string Reports the status of XWSIGMA
======================= ================= ================ ===================================================

======================= ================= ================ ===================================================
CHECK SPECTRA KEY Example Value Type Comment
======================= ================= ================ ===================================================
DELTAMAG 500 float[500] List of mag diff b/w the fibermag and the imaging mag from the fibermap
DELTAMAG_STATUS ALARM string Status of DELTAMAG_TGT
DELTAMAG_STATUS NORMAL string Status of DELTAMAG_TGT
DELTAMAG_TGT [-2.92,...] float[N] List of the average fiber mag per target types in this camera
FIBER_MAG [18.22, ...] float[500] Magnitude of the 500 fibers
FIDSNR_STATUS ALARM string Reports the status of FIDSNR_TGT
FIDSNR_STATUS NORMAL string Reports the status of FIDSNR_TGT
FIDSNR_TGT 4 float[4] List of fiducial SNR per target type
FITCOEFF_TGT 4,2 float[4,2] List of 4[a,B] Best fit throughput("a") & sky b/g "B" per target
FITCOVAR_TGT 4,2x2 float[16] List of 2x2 covariance matrices [[[c1,c2],[c3,c4]], ...]
MEDIAN_SNR [1.3,...] float[500] Median SNR per fiber
NSKY_FIB 37 int Number of sky fibers
NUM_NEGATIVE_SNR 0 int Number of targets with negative SNR
PEAKCOUNT 500 float[500] Sum of counts in peak regions per fiber
PEAKCOUNT_MED_SKY [] float[] Median of PEAKCOUNT over sky fibers
PEAKCOUNT 1 float Averaged summed counts for sky fibers over specified peak sky wavelengths
PEAKCOUNT_FIB [91.56,...] float[500] summed counts over sky peaks on ALL the 500 fibers
PEAKCOUNT_NOISE 0.072 float rms of PEAKCOUNT over sky fibers FOR SCIENCE EXPOSURES
PEAKCOUNT_STATUS ALARM string reports the status of the PEAKCOUNT
SKYCONT 210.0 float Sky cont. in all configured continuum areas averaged over all
PEAKCOUNT_STATUS NORMAL string reports the status of the PEAKCOUNT
SKYCONT 210.0 float SKY cont. in all configured continuum areas averaged over all
sky fibers
SKYCONT_FIBER 357.238 float[N] Sky continuum per sky fiber averaged over two continuum regions,
SKYCONT_FIBER 357.238 float[N] SKY continuum per sky fiber averaged over two continuum regions,
'N' is number of sky fibers
SKYCONT_STATUS NORMAL string Reports the status of the SKYCONT
SNR_MAG_TGT 4 float[N] List of average SNR for target type, N is number of target types
SNR_RESID 436 float[Nobj] List of the SNR values for the targets, Nobj is 500-Nskyfibers
STAR_FIBERID 11 int[ns] Fiber IDs for standard STARs, ns is number of the STARs
STD_FIBERID 11 int[n] Star Fiber IDs
Sky_Rband 1000 float Average value of sky bg in R-band-> to come from ETC (current
SKYRBAND 100 float Average value of sky bg in R-band-> to come from ETC (current
value is a place holder)
Sky_Rflux_diff [] float[N] Diff b/w flux from sky monitor and the calculated mag from the
SKYRBAND_STATUS ALARM string Reports the status of the SKYRBAND
SKY_RFLUX_DIFF 31.744744 float Diff b/w flux from sky monitor and the averaged calculated mag from the
sky fibers
Sky_fib_Rband 1000 float Average sky fiber mag in camera r [if the camera is not r, this
is equal to the value of the Sky_Rband]
SKY_FIB_RBAND [64.109,...] float[N] Sky fiber mags in camera r [if the camera is not r, this
is equal to the value of the SKYRBAND]
WAVELENGTH 5630...7740 float[NWAVE] Wavelength (Ang.) in NWAVE bins
WAVG_RES_WAVE 2701 float[NWAVE] Wavelength (Ang.)in NWAVE bins for the sky residual
======================= ================= ================ ===================================================

Example JSON Output
~~~~~~~~~~~~~~~~~~~
The file has 15267 lines!
The file has 14667 lines!

0 comments on commit 1ed85bd

Please sign in to comment.