Skip to content

nicolaschotard/lsst_drp_analysis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

51 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LSST data release production (drp) analysis

  • Purpose: A 2-days tutorial on how to analyze LSST-stack output data using python
  • For: Someone who wants to use the LSSt stack output and start analyzing it with Python
  • Where: CC-IN2P3, Lyon, France
  • When: Octobre 3-4, 2017

Outline

1 Introduction ------------

  • Short reminder about Python
  • What is the LSST stack, and what is it for
  • What tools will we be using today

2 The LSST stack --------------

2.1 How to install and setup the LSST stack ` - Stable version and weeklies - Setup of stack-install packages - Install and setup of a non-stack packages 2.2 Overview of the data processing`

  • My input data, and what obs_* should I be using
  • Tasks and command line tools
  • A complete data reprocessing work-flow
  • What catalogs are produced and from which step of the pipeline

2.3 Access the data ` - What is a data dataIds - an example with CFHT data - Get and open images - Get and load catalogs - First step to analysis 3 Python libraries for data analysis ---------------------------------- 3.1 Overview of useful python libraries: a non-exausthive list

  • useful native functionalities
  • numpy
  • scipy
  • math
  • pandas
  • matplotlib, seaborn
  • astropy
  • astroquery
  • pyfits, h5py
  • yaml, json, (c)Pickle
  • healpy

3.2 In more details ` - `numpy` - `astropy` - `scipy` - `matplotlib` - `other` 4 Build a python package for data analysis ---------------------------------------- 4.1 Short tutotial to build a python package- setup.py - pypy - libraries - notebooks - install and test your code localy 4.2 Share your work and make it useful

  • git / github: basic functionnalities
  • continuous integration: Travis-CI
  • documentation: sphinx and readthedoc
  • static code analysis (how well my code is written): landscape
  • "dynamic" code analysis (make and run my unit/integration tests): codecov

5 Conclusion ----------

TBD

Requirements

Install

  • Python 3 (conda install is the easiest way)
  • Python libraries from the requirements.txt
  • git + a github account

Knowledge

  • install python - a lot of way to do that, and that could be a mess
  • install a python package
  • ipython
  • jupyter notebook
  • basis knowledge on python

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published