Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ql sep2018 updates #60

Merged
merged 6 commits into from
Sep 7, 2018
Merged

Ql sep2018 updates #60

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
8756775
sky resid QA is no longer getting calculated in QL
Srheft Sep 6, 2018
67bee86
added a json for the new json for trace shifts
Srheft Sep 7, 2018
41f71a2
added a json for the new json for trace shifts
Srheft Sep 7, 2018
3a2a1e3
added two jsons for the the ne Qas CHECKFLAT and CHECKARC
Srheft Sep 7, 2018
341e325
index edit
Srheft Sep 7, 2018
ef54617
index edit
Srheft Sep 7, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
13 changes: 8 additions & 5 deletions doc/QUICKLOOK/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,15 +6,18 @@ QUICKLOOK
:maxdepth: 1

$ql-checkHDUs-{camera}-{expid}.json : QA Result of matching camera and expid in the raw header <ql-checkHDUs-CAMERA-EXPID>
$ql-checkfibflat-{camera}-{expid}.json : QA output for examining fiber flat and test for stability and consistency <ql-checkfibflat-CAMERA-EXPID>
$ql-checkres-{camera}-{expid}.json : QA output for examining W sigmas and evaluates the resolution fitting solution for the arc lines <ql-checkres-CAMERA-EXPID>
$ql-countbins-{camera}-{expid}.json : QA output counting bins in spectrum above thresholds <ql-countbins-CAMERA-EXPID>
$ql-countpix-{camera}-{expid}.json : QA output counting pixels above threshold <ql-countpix-CAMERA-EXPID>
$ql-getbias-{camera}-{expid}.json : QA output concerning bias in oversan <ql-getbias-CAMERA-EXPID>
$ql-getrms-{camera}-{expid}.json : QA output concerning RMS in preprocessed image <ql-getrms-CAMERA-EXPID>
$ql-countpix-{camera}-{expid}.json : QA output counting pixels above threshold <ql-countpix-CAMERA-EXPID>
$ql-xwsigma-{camera}-{expid}.json : QA output fitting X and W sigmas to preprocessed spectra <ql-xwsigma-CAMERA-EXPID>
$ql-countbins-{camera}-{expid}.json : QA output counting bins in spectrum above thresholds <ql-countbins-CAMERA-EXPID>
$ql-integ-{camera}-{expid}.json : QA output calculating total counts for standard stars <ql-integ-CAMERA-EXPID>
$ql-skycont-{camera}-{expid}.json : QA output from sky continuum calculation <ql-skycont-CAMERA-EXPID>
$ql-skypeak-{camera}-{expid}.json : QA output calculating statistics at peak sky wavelengths <ql-skypeak-CAMERA-EXPID>
$ql-skyRband-{camera}-{expid}.json : QA output comparing skyflux in Rband with that of the skymonitor <ql-skyRband-CAMERA-EXPID>
$ql-skyresid-{camera}-{expid}.json : QA Residuals for sky fibers after subtraction <ql-skyresid-CAMERA-EXPID>
$ql-integ-{camera}-{expid}.json : QA output calculating total counts for standard stars <ql-integ-CAMERA-EXPID>
$ql-snr-{camera}-{expid}.json : QA output for the signal to noise calculation after sky subtraction <ql-snr-CAMERA-EXPID>
$ql-trace-{camera}-{expid}.json : QA output calculating the average shifts in pixels in X and Y directions over all 500 fibers <ql-trace-CAMERA-EXPID>
$ql-xwsigma-{camera}-{expid}.json : QA output fitting X and W sigmas to preprocessed spectra <ql-xwsigma-CAMERA-EXPID>
$ql-mergedQA-{camera}-{expid}.json : QAs grouped by tasks CHECK_HDUs, CHECK_CCDs, CHECK_FIBERS, CHECK_SPECTRA <ql-mergedQA-CAMERA-EXPID>

89 changes: 89 additions & 0 deletions doc/QUICKLOOK/ql-checkfibflat-CAMERA-EXPID.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,89 @@
=================================
ql-checkfibflat-CAMERA-EXPID.json
=================================

:Summary: This QA for QuickLook includes the calculation of the average shifts of the fiber trace in x and y direction over all the 500 fibers
:Naming Convention: ``ql-checkfibflat-{ARM}{SPECTROGRAPH}-{EXPID}.json``, where
{ARM} is the 1-char arm name (r,b,z), {SPECTROGRAPH} indexes
CCDs 0-9 on that arm, and {EXPID} is the 8-digit exposure ID.
Together, {ARM}{SPECTROGRAPH} specify a {CAMERA}.
:Regex: ``ql-checkfibflat-[brz][0-9]-[0-9]{8}\.json``
:File Type: JSON


Inputs
======

Written by qa_quicklook.py, with Flexure using:

- frame
- psf

Contents
========

========== ================ ==================================================
KEYNAME Type Contents
========== ================ ==================================================
XYSHIFTS Py dictionary average shifts fiber traces in X,Y over 500 fibers
========== ================ ==================================================



Dictionary Contents
===================

KEYNAME = XYSHIFTS

Averaged shifts of fiber traces in X and Y directions in pixel unit across the CCD

Keyword Description
~~~~~~~~~~~~~~~~~~~

===================== ============= ========== ============================================================
KEY Example Value Type Comment
===================== ============= ========== ============================================================
CAMERA r1 string b0-b9, r0-r9, z0-z9
EXPID 00003574 int Exposure ID
FLAVOR flat string The type of exposure that can be flat, arc or science
PANAME Flexure string Name of pipeline algorihm
QATIME 2018-09-07T float Timestamp (UTC) of time of QA execution
01:17:34.826
NIGHT 20191001 int The night of observation
PROGRAM flat string Name of the observing program: dark, grey, bright
CHECKFLAT 6684.7 double The average wavelength in the fiberflat frame
CHECKFLAT_STATUS "NORMAL" string Reports the status of the CHECKFLAT
===================== ============= ========== ============================================================

Example JSON Output
~~~~~~~~~~~~~~~~~~~

::


{
"CAMERA": "r1",
"EXPID": "00003574",
"FLAVOR": "flat",
"METRICS": {
"CHECKFLAT": 6684.799999962981,
"CHECKFLAT_STATUS": "NORMAL"
},
"NIGHT": "20191001",
"PANAME": "ComputeFiberflat_QL",
"PARAMS": {
"CHECKFLAT_NORMAL_RANGE": [
-0.5,
0.5
],
"CHECKFLAT_REF": [
6690.0
],
"CHECKFLAT_WARN_RANGE": [
-1.0,
1.0
]
},
"PROGRAM": "FLAT",
"QATIME": "2018-09-07T04:27:02.080062"
}
197 changes: 197 additions & 0 deletions doc/QUICKLOOK/ql-checkres-CAMERA-EXPID.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,197 @@
==============================
ql-checkres-CAMERA-EXPID.json
==============================

:Summary: This QA for QuickLook includes the calculation of the average shifts of the fiber trace in x and y direction over all the 500 fibers
:Naming Convention: ``ql-checkres-{ARM}{SPECTROGRAPH}-{EXPID}.json``, where
{ARM} is the 1-char arm name (r,b,z), {SPECTROGRAPH} indexes
CCDs 0-9 on that arm, and {EXPID} is the 8-digit exposure ID.
Together, {ARM}{SPECTROGRAPH} specify a {CAMERA}.
:Regex: ``ql-checkres-[brz][0-9]-[0-9]{8}\.json``
:File Type: JSON


Inputs
======

Written by qa_quicklook.py, with Check_Resolution using:

- frame
- psf

Contents
========

========== ================ ==================================================
KEYNAME Type Contents
========== ================ ==================================================
XYSHIFTS Py dictionary average shifts fiber traces in X,Y over 500 fibers
========== ================ ==================================================



Dictionary Contents
===================

KEYNAME = XYSHIFTS

Averaged shifts of fiber traces in X and Y directions in pixel unit across the CCD

Keyword Description
~~~~~~~~~~~~~~~~~~~

===================== ============= ========== ============================================================
KEY Example Value Type Comment
===================== ============= ========== ============================================================
CAMERA r1 string b0-b9, r0-r9, z0-z9
EXPID 00003571 int Exposure ID
FLAVOR flat string The type of exposure that can be flat, arc or science
PANAME Flexure string Name of pipeline algorihm
QATIME 2018-09-07T float Timestamp (UTC) of time of QA execution
01:17:34.826
NIGHT 20191001 int The night of observation
PROGRAM arc string Name of the observing program: dark, grey, bright
CHECKARC [23,18,26] int[3] Number of fibers for which the first, second and third Legendre
polynomial in their best-fit resolution solution are outside 2sigmas from the median of each
CHECKARC_STATUS "NORMAL" string Reports the status of the CHECKARC
===================== ============= ========== ============================================================

Example JSON Output
~~~~~~~~~~~~~~~~~~~

::

{
"CAMERA": "r1",
"DATA": {
"LPolyCoef0": [
[
1.1546194553375244
],
[
1.1298854351043701
],
[
1.1285881996154785
],
[
1.06905996799469
],
[
1.1458834409713745
],
[
1.1604336500167847
],
[
1.160584568977356
],
[
1.1441446542739868
],
[
1.1145886182785034
],
[
1.1415733098983765
],
[
1.16229248046875
],
[
1.1364524364471436
],
[
1.1153147220611572
],
[
1.1442683935165405
],
[
1.118243932723999
],
[
1.0786961317062378
],
[
1.1481678485870361
],
[
1.1409870386123657
],
[
1.1507529020309448
],
[
1.1144084930419922
],
[
1.120363473892212
],
[
1.1253105401992798
],
[
1.140156865119934
],
[
1.155348539352417
],
[
1.099780797958374
],
[
1.1433981657028198
],
[
1.1111900806427002
],
[
1.1020066738128662
],
[
1.1268459558486938
],...
]
},
"EXPID": "00003571",
"FLAVOR": "arc",
"METRICS": {
"CHECKARC": [
23,
18,
26
],
"CHECKARC_STATUS": "NORMAL",
"Medians": [
1.1275367736816406,
0.09040199220180511,
0.0586770698428154
],
"RMS": [
0.02402067370712757,
0.04956553503870964,
0.06509114801883698
]
},
"NIGHT": "20191001",
"PANAME": "ResolutionFit",
"PARAMS": {
"CHECKARC_NORMAL_RANGE": [
-50,
50
],
"CHECKARC_REF": [
5,
5,
5
],
"CHECKARC_WARN_RANGE": [
-100,
100
]
},
"PROGRAM": "ARC",
"QATIME": "2018-09-07T03:37:08.470691"
}

6 changes: 3 additions & 3 deletions doc/QUICKLOOK/ql-countbins-CAMERA-EXPID.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,15 +46,15 @@ KEY Example Value Type Comment
===================== ============= ========== ============================================================
CAMERA b4 string b0-b9, r0-r9, z0-z9
EXPID 00003900 int Exposure ID
FLAVOR science string The type of exposure that can flat, arc or science
FLAVOR science string The type of exposure that can be flat, arc or science
PANAME BoxcarExtract string Name of pipeline algorihm
QATIME 2018-05-27T float Timestamp (UTC) of time of QA execution
11:33:21.646
NIGHT 20191017 int The night of observation
PROGRAM dark string name of the observing program: dark, grey, bright
PROGRAM dark string name of the observing program: dark, gray, bright

NGOODFIB 500 int number of fibers with a nonzero number of bins above highest threshold
N_KNOWN_BROKEN_FIBERS 0 int number od known broken fibers
N_KNOWN_BROKEN_FIBERS 0 int number of known broken fibers
NGOODFIB_STATUS "NORMAL" string
===================== ============= ========== ============================================================

Expand Down
2 changes: 1 addition & 1 deletion doc/QUICKLOOK/ql-getbias-CAMERA-EXPID.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Inputs

Written by qa_quicklook.py, with Bias_From_Overscan using:

- pix 2D file
- preproc image

Contents
========
Expand Down
2 changes: 1 addition & 1 deletion doc/QUICKLOOK/ql-getrms-CAMERA-EXPID.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Inputs

Written by qa_quicklook.py, with Get_RMS using:

- pix 2D file
- preproc image

Contents
========
Expand Down