Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates for files in fuji and guadalupe #102

Merged
merged 65 commits into from
May 31, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
add244d
add top-level tiles file
weaverba137 Feb 18, 2022
c8080d5
add file to index
weaverba137 Mar 3, 2022
c5d1bb9
update notebook
weaverba137 Mar 11, 2022
a6b043e
add biasnighttest
weaverba137 Mar 11, 2022
e945984
add biasnight
weaverba137 Mar 11, 2022
168f972
update biasnighttest
weaverba137 Mar 11, 2022
f2cf2e2
handle astropy undefined cards
weaverba137 Mar 11, 2022
c842496
update test suite
weaverba137 Mar 11, 2022
33f8ce0
fix style
weaverba137 Mar 11, 2022
9ecd5f3
tweak python versions
weaverba137 Mar 11, 2022
166cb20
update fit-psf files
weaverba137 Mar 11, 2022
4fe2caf
stop 3.10 for now
weaverba137 Mar 11, 2022
b03739f
add fit-psf files
weaverba137 Mar 11, 2022
b718467
Merge remote-tracking branch 'origin/fuji-guadalupe' into fuji-guadalupe
weaverba137 Mar 11, 2022
c26a7f2
fix cross-references
weaverba137 Mar 11, 2022
9d897b8
restore various fit-psf files
weaverba137 Mar 11, 2022
9c9810a
fix further fix-psf errors
weaverba137 Mar 11, 2022
ecdcc76
update test notebook
weaverba137 Mar 11, 2022
796a043
add emline file
weaverba137 Mar 14, 2022
6600a96
update regex in healpix files
weaverba137 Mar 14, 2022
a43df61
add emline, zmtl
weaverba137 Mar 14, 2022
297deac
update regular expressions
weaverba137 Mar 14, 2022
a127655
update test notebook
weaverba137 Mar 14, 2022
0efa6b2
add .fits.gz as valid extension
weaverba137 Mar 22, 2022
36ab3ac
identify all known file types
weaverba137 Mar 22, 2022
6db2b7d
fix indent error
weaverba137 Mar 22, 2022
24e73f6
remove hard-code of expected types
weaverba137 Mar 23, 2022
cedf7df
add test files
weaverba137 Apr 5, 2022
49dd956
test for bad format
weaverba137 Apr 5, 2022
8fd275a
increased coverage
weaverba137 Apr 5, 2022
4c47a69
testing collapsible sections
weaverba137 Apr 12, 2022
52e19b9
install sphinx-toolbox in test
weaverba137 Apr 12, 2022
bb7c573
lstrip table rows to allow for collapse
weaverba137 Apr 12, 2022
64524d9
add custom stylesheet
weaverba137 Apr 12, 2022
41e8ffa
working css to highlight with different colors
weaverba137 Apr 13, 2022
db70fb2
add comments to css
weaverba137 Apr 13, 2022
a66b40b
special
weaverba137 May 12, 2022
591953a
fix emline regex
weaverba137 May 12, 2022
7b4979c
GROUPID for directories different from GROUPID for files
weaverba137 May 12, 2022
fd99ea6
fix style
weaverba137 May 12, 2022
83973b2
regex for fiberflatexp
weaverba137 May 12, 2022
84ae21f
fit-psf
weaverba137 May 12, 2022
053b8ae
tiles regex
weaverba137 May 13, 2022
67f0069
add zall files
weaverba137 May 13, 2022
39275d1
fix cross-ref
weaverba137 May 13, 2022
2c55afb
add sphinx-toolbox to general requirements
weaverba137 May 13, 2022
3bea964
more specific css matching
weaverba137 May 13, 2022
6d3cc97
always add special formatting to new tables
weaverba137 May 13, 2022
9a9d030
update columns for exposures
weaverba137 May 13, 2022
015eaf1
update columns for exposures
weaverba137 May 13, 2022
cc54038
update columns for exposures [skip ci]
weaverba137 May 13, 2022
035102b
better logging of missing columns
weaverba137 May 13, 2022
bf4f7e5
add references to hdus
weaverba137 May 13, 2022
9c24cb2
remove print statement
weaverba137 May 13, 2022
5bd3573
clearer warning about missing EXTNAME
weaverba137 May 13, 2022
f846187
updating data models
weaverba137 May 14, 2022
4fe4ce1
add support for optional columns
weaverba137 May 14, 2022
f9e2c98
move api to separate file
weaverba137 May 14, 2022
049a6a7
updating models
weaverba137 May 14, 2022
19ea5b6
more updates to keywords and optional columns
weaverba137 May 18, 2022
d3b9030
keywords for zcatalog files
weaverba137 May 19, 2022
9444d11
support for optional keywords
weaverba137 May 19, 2022
4f98568
mark NIGHT keyword as optional
weaverba137 May 19, 2022
c4a691e
update preproc files
weaverba137 May 19, 2022
6a688af
support variable-size columns
weaverba137 May 19, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
24 changes: 13 additions & 11 deletions .github/workflows/python-package.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,8 +17,9 @@ jobs:
fail-fast: true
matrix:
os: [ubuntu-latest]
python-version: [3.7, 3.8, 3.9]
astropy-version: ['<4.1', '<5.0']
python-version: ['3.8', '3.9'] #, '3.10'] Astropy4 plust 3.10 doesn't seem to work very well.
astropy-version: ['<4.1', '<5.0', '<5.1']
desiutil-version: ['3.2.5']

steps:
- name: Checkout code
Expand All @@ -33,8 +34,8 @@ jobs:
run: |
python -m pip install --upgrade pip wheel
python -m pip install pytest
if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
pip install -U "astropy${{ matrix.astropy-version }}"
python -m pip install "git+https://github.com/desihub/desiutil.git@${{ matrix.desiutil-version }}#egg=desiutil"
python -m pip install "astropy${{ matrix.astropy-version }}"
- name: Run the test
run: |
pytest
Expand All @@ -46,7 +47,7 @@ jobs:
fail-fast: true
matrix:
os: [ubuntu-latest]
python-version: [3.8]
python-version: [3.9]

steps:
- name: Checkout code
Expand All @@ -61,7 +62,7 @@ jobs:
run: |
python -m pip install --upgrade pip wheel
python -m pip install pytest pytest-cov coveralls
if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
python -m pip install -r requirements.txt
- name: Run the test with coverage
run: |
pytest --cov
Expand All @@ -79,7 +80,7 @@ jobs:
fail-fast: false
matrix:
os: [ubuntu-latest]
python-version: [3.8]
python-version: [3.9]

steps:
- name: Checkout code
Expand All @@ -93,19 +94,20 @@ jobs:
- name: Install Python dependencies
run: |
python -m pip install --upgrade pip wheel
python -m pip install docutils\<0.18 Sphinx
python -m pip install Sphinx sphinx-toolbox
- name: Test the documentation
run: |
sphinx-build -W --keep-going -b html doc doc/_build/html

style:
name: Check code style; allow failures.
# name: Check code style; allow failures.
name: Check code style.
runs-on: ${{ matrix.os }}
strategy:
fail-fast: false
matrix:
os: [ubuntu-latest]
python-version: [3.8]
python-version: [3.9]

steps:
- name: Checkout code
Expand All @@ -122,6 +124,6 @@ jobs:
python -m pip install pycodestyle
- name: Test the style
# This is equivalent to an allowed falure.
continue-on-error: true
# continue-on-error: true
run: |
pycodestyle --count py/desidatamodel
1,286 changes: 650 additions & 636 deletions doc/DESI_SPECTRO_DATA/NIGHT/EXPID/desi-EXPID.rst

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,161 @@
===========================
biasnight-CAMERA-NIGHT.fits
===========================

:Summary: *This section should be filled in with a high-level description of
this file. In general, you should remove or replace the emphasized text
(\*this text is emphasized\*) in this document.*
:Naming Convention: ``biasnight-CAMERA-NIGHT.fits.gz``, where ``CAMERA`` is
*e.g.*, "b0", "r5", etc. and ``NIGHT`` is the observation night in
YYYYMMDD format.
:Regex: ``biasnight-[brz][0-9]-[0-9]{8}\.fits\.gz``
:File Type: FITS, 20 MB

Contents
========

====== ======= ===== ===================
Number EXTNAME Type Contents
====== ======= ===== ===================
HDU0_ BIAS IMAGE *Brief Description*
====== ======= ===== ===================


FITS Header Units
=================

HDU0
----

EXTNAME = BIAS

*Summarize the contents of this HDU.*

Required Header Keywords
~~~~~~~~~~~~~~~~~~~~~~~~

.. collapse:: Required Header Keywords table

.. rst-class:: keywords

======== ===================================== ===== =======================================
KEY Example Value Type Comment
======== ===================================== ===== =======================================
NAXIS1 4256 int
NAXIS2 4194 int
TELESCOP KPNO 4.0-m telescope str Telescope name
INSTRUME DESI str Instrument name
SPECGRPH 8 int Spectrograph logical name (SP)
SPECID 2 int Spectrograph serial number (SM)
DETECTOR M1-42 str Detector (ccd) identification
CAMERA z8 str Camera name
CCDNAME CCDSM2Z str CCD name
CCDPREP purge,clear str CCD prep actions
CCDSIZE 4194,4256 str CCD size in pixels (rows, columns)
CCDTEMP -136.0659 float [deg C] CCD controller CCD temperature
CPUTEMP 57.3633 float [deg C] CCD controller CPU temperature
CASETEMP 57.3533 float [deg C] CCD controller case temperature
CCDTMING flatdark_lbnl_timing.txt str CCD timing file
CCDCFG default_lbnl_20210128.cfg str CCD configuration file
SETTINGS detectors_sm_20210128.json str Name of DESI CCD settings file
VESSEL 9 int Cryostat serial number
FEEVER v20160312 str CCD Controller version
FEEBOX lbnl055 str CCD Controller serial number
PRESECA [1:7, 2:2065] str Prescan section for quadrant A
PRRSECA [8:2064, 1:1] str Row prescan section for quadrant A
DATASECA [8:2064, 2:2065] str Data section for quadrant A
TRIMSECA [8:2064, 2:2065] str Trim section for quadrant A
BIASSECA [2065:2128, 2:2065] str Bias section for quadrant A
ORSECA [8:2064, 2066:2097] str Row overscan section for quadrant A
CCDSECA [1:2057, 1:2064] str CCD section for quadrant A
DETSECA [1:2057, 1:2064] str Detector section for quadrant A
AMPSECA [1:2057, 1:2064] str AMP section for quadrant A
PRESECB [4250:4256, 2:2065] str Prescan section for quadrant B
PRRSECB [2193:4249, 1:1] str Row prescan section for quadrant B
DATASECB [2193:4249, 2:2065] str Data section for quadrant B
TRIMSECB [2193:4249, 2:2065] str Trim section for quadrant B
BIASSECB [2129:2192, 2:2065] str Bias section for quadrant B
ORSECB [2193:4249, 2066:2097] str Row overscan section for quadrant B
CCDSECB [2058:4114, 1:2064] str CCD section for quadrant B
DETSECB [2058:4114, 1:2064] str Detector section for quadrant B
AMPSECB [4114:2058, 1:2064] str AMP section for quadrant B
PRESECC [1:7, 2130:4193] str Prescan section for quadrant C
PRRSECC [8:2064, 4194:4194] str Row prescan section for quadrant C
DATASECC [8:2064, 2130:4193] str Data section for quadrant C
TRIMSECC [8:2064, 2130:4193] str Trim section for quadrant C
BIASSECC [2065:2128, 2130:4193] str Bias section for quadrant C
ORSECC [8:2064, 2098:2129] str Row overscan section for quadrant C
CCDSECC [1:2057, 2065:4128] str CCD section for quadrant C
DETSECC [1:2057, 2065:4128] str Detector section for quadrant C
AMPSECC [1:2057, 4128:2065] str AMP section for quadrant C
PRESECD [4250:4256, 2130:4193] str Prescan section for quadrant D
PRRSECD [2193:4249, 4194:4194] str Row prescan section for quadrant D
DATASECD [2193:4249, 2130:4193] str Data section for quadrant D
TRIMSECD [2193:4249, 2130:4193] str Trim section for quadrant D
BIASSECD [2129:2192, 2130:4193] str Bias section for quadrant D
ORSECD [2193:4249, 2098:2129] str Row bias section for quadrant D
CCDSECD [2058:4114, 2065:4128] str CCD section for quadrant D
DETSECD [2058:4114, 2065:4128] str Detector section for quadrant D
AMPSECD [4114:2058, 4128:2065] str AMP section for quadrant D
DAC0 -9.0002,-9.0331 str [V] set value, measured value
DAC1 -9.0002,-8.9816 str [V] set value, measured value
DAC2 -9.0002,-8.961 str [V] set value, measured value
DAC3 -9.0002,-8.9816 str [V] set value, measured value
DAC4 5.9998,6.0437 str [V] set value, measured value
DAC5 5.9998,6.0595 str [V] set value, measured value
DAC6 5.9998,5.9964 str [V] set value, measured value
DAC7 5.9998,6.0069 str [V] set value, measured value
DAC8 -25.0003,-25.0796 str [V] set value, measured value
DAC9 -25.0003,-25.3467 str [V] set value, measured value
DAC10 -25.0003,-25.0648 str [V] set value, measured value
DAC11 -25.0003,-25.3467 str [V] set value, measured value
DAC12 0.0,-0.0148 str [V] set value, measured value
DAC13 0.0,-0.0297 str [V] set value, measured value
DAC14 0.0,-0.0297 str [V] set value, measured value
DAC15 0.0,-0.0148 str [V] set value, measured value
DAC16 39.9961,39.4548 str [V] set value, measured value
DAC17 20.0008,12.2854 str [V] set value, measured value
CLOCK0 9.9999,0.0 str [V] high rail, low rail
CLOCK1 9.9999,0.0 str [V] high rail, low rail
CLOCK2 9.9999,0.0 str [V] high rail, low rail
CLOCK3 -2.0001,3.9999 str [V] high rail, low rail
CLOCK4 9.9999,0.0 str [V] high rail, low rail
CLOCK5 9.9999,0.0 str [V] high rail, low rail
CLOCK6 9.9999,0.0 str [V] high rail, low rail
CLOCK7 -2.0001,3.9999 str [V] high rail, low rail
CLOCK8 9.9992,2.9993 str [V] high rail, low rail
CLOCK9 9.9992,2.9993 str [V] high rail, low rail
CLOCK10 9.9992,2.9993 str [V] high rail, low rail
CLOCK11 9.9992,2.9993 str [V] high rail, low rail
CLOCK12 9.9992,2.9993 str [V] high rail, low rail
CLOCK13 9.9992,2.9993 str [V] high rail, low rail
CLOCK14 9.9992,2.9993 str [V] high rail, low rail
CLOCK15 9.9992,2.9993 str [V] high rail, low rail
CLOCK16 9.9999,3.0 str [V] high rail, low rail
CLOCK17 9.0,0.9999 str [V] high rail, low rail
CLOCK18 9.0,0.9999 str [V] high rail, low rail
OFFSET0 0.4000000059604645,-9.0434 str [V] set value, measured value
OFFSET1 0.4000000059604645,-8.9816 str [V] set value, measured value
OFFSET2 0.4000000059604645,-8.961 str [V] set value, measured value
OFFSET3 0.4000000059604645,-8.9713 str [V] set value, measured value
OFFSET4 2.0,6.0385 str [V] set value, measured value
OFFSET5 2.0,6.0648 str [V] set value, measured value
OFFSET6 2.0,6.0017 str [V] set value, measured value
OFFSET7 2.0,6.0017 str [V] set value, measured value
DELAYS 20, 20, 25, 40, 7, 3000, 7, 7, 400, 7 str [10] Delay settings
CDSPARMS 400, 400, 8, 2000 str CDS parameters
PGAGAIN 3 int Controller gain
OCSVER 1.2 float OCS software version
DOSVER trunk str DOS software version
CONSTVER DESI:CURRENT str Constants version
BUNIT adu str
NIGHT 20210407 int
======== ===================================== ===== =======================================

Data: FITS image [float32, 4256x4194]


Notes and Examples
==================

*Add notes and examples here. You can also create links to example files.*