Home

Welcome to the dataqa wiki!

Scripts for data QA

Wrapper scripts for specific data QA should live at the top level. There are separate directories for scripts/code related to each type of data QA. E.g.

run_crosscalQA.py
crosscal
->ccal_plots.py

Procedure

1. Initial setup

   1. Log-in to Happili-01
   2. Open a screen session (optional, but recommended)
      • Example: screen -S dataqa
   3. Set environment for apercal (if not already done)
      • See https://github.com/apertif/apercal/wiki/Running-apercal-on-happili
   4. Run set_up_qa.py
      • Example: python set_up_qa.py <obs_id>
      • This will create the directory structure by default to /data/apertif/<TASKID>/qa

2. Run crosscal qa

   • Example: python run_ccal_plots <scannumber> <fluxcal> [-p --/path/to/write/images/too]

3. Run selfcal qa

4. Run continuum qa

   1. Run continuum validation
      • Example: python run_continuum_validation.py <obs_id>
      • The script creates a directory for each beam in /data/apertif/<TASKID>/qa/continuum/<beam>/pybdsf/. Otherwise, there would be too many files in a single directory.

5. Run line qa

6. Run mosaic qa

   1. Run mosaic

      • python make_mosaic_image.py <obs_id>

      • This script will create a directory: /data/apertif/<obs_id>/mosaic/ and place the mosaic image there (miriad image + fits image).

      • If not all of the beams have a continuum image there will be an error message, but the script will still run and create a mosaic from the beams that have a continuum image fits file.

      • The script breaks if there are no beams at all to mosaic.

   2. Run pybdsf

      • Example: `python run_continuum_validation.py <obs_id> --for_mosaic

7. Put relevant information into Google-Doc