Tile completeness

[julienguy]

Tile completeness code. It's only valid for now for SV1 processing, but I suggest we merge that to have some of the framework in place.

• changes to desi_tsnr_afterburner
  • check in prod exposure table for missing/failed exposures and add them with TSNR2=0
  • add option --tile-completeness to write a summary tile file with columns:

TILEID,EXPTIME,NEXP,ELG_EFFTIME_DARK,BGS_EFFTIME_BRIGHT,OBSSTATUS,ZSTATUS,SURVEY,GOALTYP,TARGETS,GOALTIME
...
80619,4801.2,16,1216.9,1109.0,OBSDONE,NONE,SV1,BRIGHT,BGS+MWS,600.0
80620,11700.7,13,8228.4,7875.7,OBSDONE,NONE,SV1,DARK,QSO+LRG,4000.0
80621,9000.5,10,4563.0,4312.9,OBSDONE,NONE,SV1,DARK,ELG,4000.0
80622,7200.4,8,5543.6,5844.3,OBSDONE,NONE,SV1,DARK,QSO+LRG,4000.0
...

• add option --aux to use an auxiliary table to get some missing information (actual unique for now case is /global/cfs/cdirs/desi/survey/observations/SV1/sv1-tiles.fits)

• add script desi_tiles_completeness which produces the same tiles table directly from the tsnr-exposures table.

Next (but arguably for another PR, because it would be good to have this in prod as long as we don't have the new fiberassign format in place).

• use FIBERMAP header keywords to get the info about SURVEY, GOALTYP, GOALTIME , possibly TARGETS.

[coveralls]

Coverage decreased (-0.1%) to 28.805% when pulling 06f1acc on tile-completeness into f3895a1 on master.

[akremin]

This looks good to me. There are a few things about how the exposure tables are handled that could be tweaked, but those should wait until they have settled down on the exposure table side. Given that this is time-critical, I think it looks great. Note that I didn't actually test it, I only read through it.

[julienguy]

The relevant keywords from the fiberassign files to the tsnr-exposures and tiles tables are now propagated. So this is supposedly ready for SV2 (but obviously not tested on actual SV2 data). It would be great the merge this to master for it to run if we have sv2 designed tiles tonight. Example command for the daily pipeline:

desi_tsnr_afterburner -o /global/cfs/cdirs/desi/spectro/redux/daily/tsnr-exposures.fits --prod daily --update --night $LASTNIGHT --tile-completeness /global/cfs/cdirs/desi/spectro/redux/daily/tiles.csv --aux /global/cfs/cdirs/desi/survey/observations/SV1/sv1-tiles.fits --nproc 8