Skip to content

Commit

Permalink
PANSTARRS catalog query through MAST@STScI implemented
Browse files Browse the repository at this point in the history
  • Loading branch information
Michael Mommert committed Mar 16, 2017
1 parent 4b7cf1a commit 645a3b2
Show file tree
Hide file tree
Showing 8 changed files with 282 additions and 118 deletions.
6 changes: 4 additions & 2 deletions _pp_conf.py
View file
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,7 @@ def setup_diagnostics():
# following warning gets cast by Gaia query: XXX.convert_unit_to(u.deg)
warnings.filterwarnings('ignore', category=np.ma.core.MaskedArrayFutureWarning)
warnings.filterwarnings('ignore', category=UserWarning)
warnings.filterwarnings('ignore', category=FutureWarning)

# read photometry pipeline root path from environment variable
rootpath = os.environ.get('PHOTPIPEDIR')
Expand Down Expand Up @@ -116,14 +117,15 @@ def setup_diagnostics():
# available catalogs

# list of available catalogs
allcatalogs = ['URAT-1', '2MASS', 'SDSS-R9', 'APASS9', 'GAIA']
allcatalogs = ['URAT-1', '2MASS', 'SDSS-R9', 'APASS9', 'GAIA', 'PANSTARRS']

# catalog magnitude systems
allcatalogs_magsys = {'URAT-1': 'Vega',
'2MASS': 'Vega',
'SDSS-R9': 'AB',
'APASS9': 'Vega',
'GAIA': 'Vega'}
'GAIA': 'Vega',
'PANSTARRS': 'AB'}

# ---- pipeline preferences
# (if you don't know what you're doing, better don't mess around here)
Expand Down
268 changes: 202 additions & 66 deletions catalog.py
View file

Large diffs are not rendered by default.

3 changes: 2 additions & 1 deletion doc/changelog.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ Changelog

Major changes to the pipeline since 2016-10-01 (see `Mommert 2017`_) are documented here.

* 2017-03-16: implementation of `Pan-STARRS DR1`_ for the photometric calibration; currently, PP uses a home-built access of MAST at STScI, which is limited to catalog queries with a maximum cone radius of 0.5 deg; please note that this kind of query is rather slow compared to Vizier queries of SDSS or APASS

* 2017-02-24: ``pillow`` is now a required python module; the pipeline now supports default distortion parameters for wide-field cameras

Expand All @@ -11,7 +12,7 @@ Major changes to the pipeline since 2016-10-01 (see `Mommert 2017`_) are documen


.. _Mommert 2017: http://adsabs.harvard.edu/abs/2017A%26C....18...47M

.. _Pan-STARRS DR1: http://panstarrs.stsci.edu/



4 changes: 2 additions & 2 deletions doc/conf.py
View file
Original file line number Diff line number Diff line change
Expand Up @@ -60,9 +60,9 @@
# built documents.
#
# The short X.Y version.
version = u'0.9'
version = u'1.0'
# The full version, including alpha/beta/rc tags.
release = u'0.9'
release = u'1.0'

# The language for content autogenerated by Sphinx. Refer to documentation
# for a list of supported languages.
Expand Down
15 changes: 7 additions & 8 deletions doc/problems.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,20 +13,19 @@ General Problems
$PHOTPIPEDIR`` in a terminal), or (2) the command ``pp_run`` uses a
symbolic link to ``pp_run.py``; if the former does not work, try
the latter.



**Running the pipeline creates warnings (e.g., FutureWarning); what
should I do?**
Warnings are usually caused by Python module version issues and
cause no harm whatsoever. In theory, there should be no warnings,
but they happen occasionally. If you are haunted by some warnings,
let me know and I will try to resolve the issue.

Warnings are usually caused by Python module version issues and
cause no harm whatsoever. In theory, there should be no warnings,
but they happen occasionally. If you are haunted by some warnings,
let me know and I will try to resolve the issue.


pp_calibrate (Photometric Calibration)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

**I keep getting output like `zeropoint for image.fits: Warning: 0 reference stars after source matching for frame image.ldac`. What does it mean?**

It means that none of the reference stars with measured magnitudes
in your field of view could be matched with a source in your
image. As a result, the magnitudes in the photometry output files
Expand Down
47 changes: 31 additions & 16 deletions doc/supported.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ observatories/instruments:
| Discovery Channel | Large Monolithic | DCTLMI |
| Telescope | Imager | |
+--------------------------+--------------------+----------------+
| KMTnet SAAO | --- * | KMTNETS |
| KMTnet SAAO | --- (*) | KMTNETS |
+--------------------------+--------------------+----------------+
| Lowell 31" | NASACAM | LOWELL31 |
+--------------------------+--------------------+----------------+
Expand All @@ -35,7 +35,7 @@ observatories/instruments:
| Observatoire Haute- | CCD | OHP120 |
| Provence 1.2m | | OHP120 |
+--------------------------+--------------------+----------------+
| SOAR 4.1m | Goodman | SOARGOODMAN |
| SOAR 4.1m | Goodman (**) | SOARGOODMAN |
+--------------------------+--------------------+----------------+
| Telescopio Nazionale | DOLORES | TNGDOLORES |
| Galileo | | |
Expand All @@ -48,11 +48,18 @@ observatories/instruments:
| Generic Telescope | any | GENERIC |
+--------------------------+--------------------+----------------+

*: This camera is a multi-detector instrument; it is recommended to
split multi-extension FITS frames from this instrument into
individual single-extension FITS images and to run the pipeline on
these individual FITS images.
(*): This camera is a multi-detector instrument; it is recommended to
split multi-extension FITS frames from this instrument into individual
single-extension FITS images and to run the pipeline on these
individual FITS images.

(**): SOAR Goodman image header have a number of non-standard keywords
that force astropy to crash; in order to use PP, please remove header
keywords ``PARAM0``, ``PARAM61``, ``PARAM62``, and ``PARAM63`` prior
to running PP, e.g., using the ``delhead`` command provided by
`WCSTools`_.


If you would like to use the pipeline for other observatories, please
contact me.

Expand All @@ -69,26 +76,31 @@ photometric calibration:
+========================+==========================+===============+==========================+============================================================+
| Gaia DR1 (`Gaia`_) | astrometric | yes | G | all-sky catalog, excellent astrometry |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+
| 2MASS (`2MASS`_) | astrometric/photometric | yes | J, H, Ks, K* | all-sky NIR catalog, good astrometry |
| 2MASS (`2MASS`_) | astrometric/photometric | yes | J, H, Ks, K* (Vega) | all-sky NIR catalog, good astrometry |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+
| URAT-1 (`URAT-1`_) | astrometric/photometric | yes (SCAMP | g, r, i, B, V, R*, | good coverage over the Northern hemisphere, photometry from|
| | | >= trunk.r345)| I* | APASS (see below) |
| URAT-1 (`URAT-1`_) | astrometric/photometric | yes (SCAMP | g, r, i (SDSS AB); | good coverage over the Northern hemisphere, photometry from|
| | | >= trunk.r345)| B, V, R*, I* (Vega) | APASS (see below) |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+
| Sloan Digital Sky | astrometric/photometric | yes | u, g, r, i, z, U*, B*, | excellent photometry, Northern hemisphere, patchy coverage |
| Survey Release 9 | | | V*, R*, I* | |
| Sloan Digital Sky | astrometric/photometric | yes | u, g, r, i, z (SDSS AB); | excellent photometry, Northern hemisphere, patchy coverage |
| Survey Release 9 | | | U*, B*, V*, R*, I* (Vega)| |
| (`SDSS-R9`_) | | | | |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+
| AAVSO Photometric All | photometric | no | g, r, i, B, V, R*, | good coverage, good photometry for stars with V<17 |
| Sky Survey Release 9 | | | I* | |
| AAVSO Photometric All | photometric | no | g, r, i (SDSS AB); | good coverage, good photometry for stars with V<17 |
| Sky Survey Release 9 | | | B, V, R*, I* (Vega) | |
| (`APASS9`_) | | | | |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+
| Pan-STARRS DR1 | photometric | no | g, r, i, z, y (SDSS AB); | good coverage, good photometry for stars with V<20; |
| (`PANSTARRS`_) | | | B*, V*, R*, I* (Vega) | currently, only cone searches with radius < 0.5 deg |
| | | | | supported |
+------------------------+--------------------------+---------------+--------------------------+------------------------------------------------------------+

The catalog name in brackets is the identifier used by PP; e.g., if
you want to use URAT-1 for the registration of your images, use option
`-cat URAT-1` with the ``pp_register`` command. The "Registration?"
column identifies if this catalog is supported by SCAMP in order to
use it for image registration. All filter bands marked with an
asterisk (*) are obtained through transformations from other bands.
asterisk (*) are obtained through transformations from other bands;
the respective photometric system is shown in brackets.


If you are interested in using catalogs other than those listed,
Expand All @@ -105,17 +117,20 @@ PP supports the following catalog transformations:

* ugriz -> BVRI: `Chonis & Gaskell 2008`_
* JHKs (2MASS) -> JHK (UKIRT): `Hodgkin et al. 2009`_

* Pan-STARRS grizy -> SDSS griz + BVRI: `Tonry et al. 2012`_

Independent checks indicate that these transformations are reliable and accurate. More quantitative results coming soon...


.. _Chonis & Gaskell 2008: http://adsabs.harvard.edu/abs/2008AJ....135..264C
.. _Hodgkin et al. 2009: http://adsabs.harvard.edu/abs/2009MNRAS.394..675H

.. _Tonry et al. 2012: http://adsabs.harvard.edu/abs/2012ApJ...750...99T

.. _Gaia: http://sci.esa.int/gaia/
.. _2MASS: http://www.ipac.caltech.edu/2mass/
.. _URAT-1: http://cdsads.u-strasbg.fr/cgi-bin/nph-bib_query?2015AJ....150..101Z&db_key=AST&nosetcookie=1
.. _SDSS-R9: http://www.sdss3.org/dr9/
.. _APASS9: http://www.aavso.org/apass
.. _PANSTARRS: http://panstarrs.stsci.edu/

.. _WCSTools: http://tdc-www.harvard.edu/wcstools/
13 changes: 12 additions & 1 deletion pp_calibrate.py
View file
Original file line number Diff line number Diff line change
Expand Up @@ -75,6 +75,14 @@ def create_photometrycatalog(ra_deg, dec_deg, rad_deg, filtername,
if n_sources < min_sources:
continue

if 'URAT' in catalogname:
print(catalogname + ' should only be used as an astrometric '
'catalog; please use APASS9 instead')
logging.error(catalogname + ' should only be used as an '
'astrometric catalog; please use APASS9 instead')
return None


# transform catalog to requested filtername, if necessesary
if ( n_sources > 0 and
('SDSS' in catalogname and
Expand All @@ -84,7 +92,10 @@ def create_photometrycatalog(ra_deg, dec_deg, rad_deg, filtername,
('APASS' in catalogname and
filtername not in {'B', 'V', 'g', 'r', 'i'}) or
('2MASS' in catalogname and
filtername not in {'J', 'H', 'K'}) ):
filtername not in {'J', 'H', 'K'}) or
('PANSTARRS' in catalogname and
filtername not in {'g', 'r', 'i', 'z', 'y'}) ):

n_transformed = cat.transform_filters(filtername) - \
cat.reject_sources_with(\
cat['_e_'+filtername+'mag'] > mag_accuracy)
Expand Down

0 comments on commit 645a3b2

Please sign in to comment.