Added procedures to IM a,b,c. Renamed IMb

lsst-sitcom · Dec 10, 2020 · 9463ffa · 9463ffa
1 parent 1954057
commit 9463ffa
Show file tree

Hide file tree

Showing 3 changed files with 119 additions and 46 deletions.
diff --git a/IMa.tex b/IMa.tex
@@ -5,39 +5,49 @@
 Run ComCam from notebooks, with generation and certification of ComCam calibrations
 
 \subsection{Goals of IM}
-\label{sec:orgbea7b56}
+
 \begin{itemize}
-\item Taking ComCam images in Chile using nublado
-\item Taking calibration and other images using the \gls{scriptQueue}
-\item Automatic ingestion into a gen3 butler in Chile
-\item Transfer over \gls{DBB Buffer manager} and the \gls{LHN} to a gen3 repo at NCSA
-\item Human generation and availability of master calibrations in Chile
-% \item EFD client access at NCSA
+	\item Taking ComCam images in Chile using nublado
+	\item Taking calibration and other images using the \gls{scriptQueue}
+	\item Automatic ingestion into a gen3 butler in Chile
+	\item Transfer over \gls{DBB Buffer manager} and the \gls{LHN} to a gen3 repo on the \gls{RSP}
+	\item Human generation and availability of master calibrations in Chile
 \end{itemize}
 
 \subsection{Prerequisites}
 \begin{itemize}
-\item{ComCam on summit}
-\begin{itemize}
-\item cold and functional
-\end{itemize}
-\item{gen3 butler ingestion for comCam}
+	\item{ComCam on summit}
+	\begin{itemize}
+		\item cold and functional
+		\item incoherent light source available to take flats
+	\end{itemize}
+	\item{gen3 butler ingestion for ComCam}
 \item{Nublado running in Chile}
 \end{itemize}
 
 \subsection{Procedure}
-\begin{itemize}
-\item Use nublado to take bias, dark, flat, and PTC calibration data
-\item Convert nublado cells to \gls{scriptQueue} and run them
-\item In Chile,
-  \begin{itemize}
-  \item Run gen3 \gls{cp_pipe} by hand from a nublado terminal
-    \begin{itemize}
-    \item Use ``auto-certify'' mode which assumes that the derived products are good
-    \item \Nb this results in the calibs being available for further use
-    \end{itemize}
-  \item Take further exposures, if possible with structured illumination
-  \item Run \gls{ISR} processing and confirm quality of resulting images
-  \end{itemize}
-\item Repeat these operations at NCSA
-\end{itemize}
+The following procedure is to be executed by a general commissioning team member. The script creation and scriptQueue requires a minor amount of training and may require assistance.
+\begin{enumerate}
+	\item Following a procedure, instantiate the OCS bridge
+	\item Using Nublado, bring to enabled state using Notebook
+	\item Using Nublado and the \href{https://ts-observatory-control.lsst.io/py-api/lsst.ts.observatory.control.maintel.ComCam.html}{ComCam class}:
+	\begin{enumerate}
+ 		\item Take a single OBJECT, BIAS, FLAT, DARK image
+ 		\item For each image, monitor event for CCCamera completion, monitor \gls{OODS} event saying image is ready, use butler to grab image, display image locally using Firefly/DS9 or camera display tool
+    \end{enumerate}	
+	\item In a notebook, create cells to take bias, dark, flat, and PTC calibration data
+	\item Convert Nublado cells to \gls{scriptQueue}, creating a ``standard Calibration'' script and execute them
+	\item From the Commissioning Cluster at the base:
+	\begin{enumerate}
+		\item Display one of each image type locally using Firefly/DS9 or camera display tool
+		\item Run gen3 \gls{cp_pipe} by hand from a Nublado terminal
+    	\begin{enumerate}
+    		\item Create master biases, flats, darks using ``auto-certify'' mode which assumes that the derived products are good \footnote{This results in the calibrations being available for use}
+    		\item Copy images to summit and include in summit Butler repo.
+    	\end{enumerate}
+  	\end{enumerate}
+ 	\item Take further exposures with structured illumination, preferably different from what was used to generate the flat.
+  	\item From the summit, run \gls{ISR} processing, display images and confirm new calibs are being applied
+	\item Once data is synced to NCSA via the \gls{LHN}, Repeat the generation of calibration images using the \gls{RSP}
+	\item Re-verify that \gls{RSP} generated calibration images can be used on the summit.
+\end{enumerate}
diff --git a/IMb.tex b/IMb.tex
@@ -1,4 +1,4 @@
-\declareIM{b}{B}{2021-XX-YY}{ComCam Image Capture and Archive}
+\declareIM{b}{B}{2021-XX-YY}{ComCam Calibration Acquisition, Transfer, and Processing}
 
 Executive Summary:
 
@@ -7,21 +7,50 @@
 \subsection{Goals of IM}
 \label{sec:org3154347}
 \begin{itemize}
-\item Triggering \gls{OCPS} processing from nublado/scriptQueue
-\item Automated generation and availability of ComCam master calibrations in Chile
-\item Use of \gls{RLS} and \gls{LOVE}
-\begin{itemize}
-\item including monitoring of data transfer to NCSA
-\end{itemize}
-\item Demonstration that the operator can cycle through states, bring
-the system up from \texttt{STANDBY}, and take data without any intervention from developers
-\item Monitor the health of the \gls{CCS} from the observatory environment (e.g. Chronograph/\gls{LOVE})
-\item Explore relationship between \gls{EFD} and Camera trending databases
-\item TAP/ADQL access to \gls{EFD} from \gls{RSP}
+	\item Triggering \gls{OCPS} processing from nublado/scriptQueue
+	\item Automated generation and availability of ComCam master calibrations in Chile
+	\item Use of \gls{RLS} and \gls{LOVE}
+	\begin{itemize}
+		\item including monitoring of data transfer to NCSA
+	\end{itemize}
+	\item Demonstration that the operator can cycle through states, bring
+	the system up from \texttt{STANDBY}, and take data without any intervention from developers
+	\item Monitor the health of the \gls{CCS} from the observatory environment (e.g. Chronograph/\gls{LOVE})
+	\item Explore relationship between \gls{EFD} and Camera trending databases
+	\item Query capability (TAP/ADQL) access to \gls{EFD} from \gls{RSP}
 \end{itemize}
 
 \subsection{Prerequisites}
 \begin{itemize}
-\item{\IM{a}}
+	\item{\IM{a} completed with functionality maintained}
+	\item{ComCam cold and functional with light source available for flat}
+\end{itemize}
+
+
+\subsection{Procedure}
+The following procedure is to be executed by an observing specialist. Assistance may be provided in the script editing and database querying by other commissioning team members.
+\begin{itemize}
+	\item Following a procedure, bring up the LOVE interface for ComCam
+	\item Using Nublado, without assistance from developers, the operator should bring ComCam to ENABLED from STANDBY
+	\item Take an OBJECT image using the \href{https://ts-observatory-control.lsst.io/py-api/lsst.ts.observatory.control.maintel.ComCam.html}{ComCam class}
+	\begin{itemize}
+		\item Verify functionality of the \gls{LOVE} interface, including the state and health
+		\item Display the raw image locally
+		\item Using the OCPS, perform basic \gls{ISR} on the image and wait for the result (e.g. "await ocps.process(visitID, task\_name)")
+		\item Display the ISR-corrected image
+		\item Monitor the transfer status and elapsed time between when the image is written on the summit to when it can be accessed at NCSA.
+	\end{itemize}	
+	\item Modify the script from \IM{a} used to take calibrations to also command the \gls{OCPS} to reduce the data
+	\begin{itemize}
+		\item Take \emph{only} a stack of $\sim$10 bias frames
+		\item Using the \gls{OCPS}, build a master bias from inside the script. Do not wait for the processing to finish 
+			\begin{itemize}
+				\item One could use "asyncio.future(ocps.process(visitID, task\_name))"
+			\end{itemize}
+		\item Ensure the bias builds and is certified % FIXME: HOW do we do this?
+	\end{itemize}
+	\item From the \gls{RSP}, query the local copy of the EFD and plot exposure time versus number since the start of this exercise
+	\item From the RSP, make the same plot using data from the Camera Trending Database
+	% FIXME: The above item requires futher detailing on how we exercise the CTD
 \end{itemize}
 
diff --git a/IMc.tex b/IMc.tex
@@ -2,7 +2,7 @@
 
 Executive Summary:
 
-Demonstrates ability to take and reduce AuxTel data using the scriptQueue
+Demonstrates ability to take and reduce AuxTel data using the scriptQueue.
 
 \subsection{Goals of IM}
 \begin{itemize}
@@ -11,15 +11,49 @@ \subsection{Goals of IM}
 \item Take data in a standard star field, including interactive re-centering
 \item Run AuxTel data analysis package in Chile and NCSA, triggered by \gls{OCPS}
 \begin{itemize}
-\item push results to \gls{EFD} (maybe??)
+\item Display results to operators % (may require publishing to EFD?)
 \end{itemize}
 \end{itemize}
 
 \subsection{Prerequisites}
 \begin{itemize}
-\item{\IM{b}}
-\item{AuxTel functional}
-\item{Available staff for night time operations}
-\item{User commenting in \gls{RLS} available}
+	\item{\IM{b} Completed}
+	\item{AuxTel and LATISS functional and ready to track a target. Rough focus should be achieved.}
+	\item{Available staff for night time operations}
+	\item{User commenting in \gls{RLS} available}
 \end{itemize}
 
+\subsection{Procedure}
+The following procedure is to be executed by an observing specialist.
+\begin{enumerate}
+	\item Using Nublado, slew to $\sim$~60 degree elevation target and start tracking
+	\item Using Nublado, measure the focus offset using the \href{https://github.com/lsst-ts/ts_externalscripts/blob/develop/python/lsst/ts/externalscripts/auxtel/latiss_cwfs_align.py}{CWFS focus script}, but launched from the notebook.
+	\item Annotate results using the \gls{RLS}
+	\item Apply the focus offset using the ATAOS, record the applied offset in the \gls{RLS}
+	\item Manually take a single OBJECT image:
+	\begin{enumerate}
+		\item Verify functionality of the \gls{LOVE} interface, including instrument setup and applied focus offset(s).
+		\item Using the \gls{OCPS}, perform basic \gls{ISR} on the image and wait for the result (e.g. "await ocps.process(visitID, task\_name)")
+		\item Display the image locally after running \gls{ISR}
+	\end{enumerate}	
+	\item Using the standard visit script launched from a notebook, slew to new target and perform automated acquisition only, script must have user verify offset prior to motion.
+	\item Perform the standard data taking sequence using the standard visit script
+	\item Perform a single image with the instrument in it's standard spectral mode, then send for reduction with the \gls{OCPS}. Wait for reduction to complete.
+	\item View the results locally in the notebook.
+	\item Perform a custom sequence using at least two items in the grating wheel and two in the filter wheel, all with different exposure times (\gls{OCPS} should only perform ISR)
+	\begin{enumerate}
+		\item Verify functionality of the \gls{LOVE} interface, including filter/grating changes/shutter movement, focus/pointing offsets, \gls{OCPS} status 
+		% Do we get any OCPS status? How do we monitor that?
+		\item Display the \gls{ISR} processed images locally as they are available
+		\item Monitor the transfer status and elapsed time between when the image is written on the summit to when it can be accessed from the \gls{RSP}.
+	\end{enumerate}	
+	\item Using the scriptQueue:
+		\begin{enumerate}
+			\item Perform standard observations of 3 targets spanning the elevation range sequentially, script must send data to \gls{OCPS} for reduction (but not await results)
+			\item Display extracted atmospheric parameters for each target % HOW?
+			\item Comment in \gls{RLS} about the weather or image quality
+			\item Perform same observations, but with a custom modified configuration (exposure time or filter adjustment)
+		\end{enumerate}
+	\item From the Base and the \gls{RSP}, redo reduction of scriptQueue visit data
+	\item From the Base and the \gls{RSP}, view the log and correlate comments against images.
+\end{enumerate}