Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New PySM 3 Galactic foregrounds simulation plan #39

Merged
merged 51 commits into from
Mar 23, 2023
Merged
Changes from 3 commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
00e947e
started work on foreground models
zonca Jun 29, 2022
0a18de9
information about bandpasses and beams
zonca Jun 29, 2022
b9c5655
file format and variable nside
zonca Jun 29, 2022
b72ef53
using same bands of sensitivity calculator
zonca Jun 29, 2022
cc4796d
number of maps and ell max
zonca Jul 2, 2022
3a7cf56
explain no cmb and no extragal
zonca Jul 2, 2022
1988ee6
ring ordering
zonca Jul 2, 2022
7ed1d28
specify using CO at 512
zonca Jul 19, 2022
5a11ab2
added dump from instrument model
zonca Aug 30, 2022
52d3e4d
notebook with instrument model extraction
zonca Aug 30, 2022
1662777
sky model names
zonca Sep 7, 2022
7e81539
specify Nside recipe
zonca Sep 7, 2022
4f4fbf0
extracted SO default resolution from mapsims, updated labels
zonca Sep 7, 2022
c6254cf
first version of common.toml
zonca Sep 7, 2022
b30a817
components toml files
zonca Sep 7, 2022
b3e49a2
moved back to mapsims
zonca Sep 7, 2022
83d36b8
use bestguess instead of realistic
zonca Sep 27, 2022
90508ef
removed toml, will import from S4
zonca Dec 6, 2022
5bb6d34
lmax = 2.5 Nside
zonca Dec 6, 2022
c82da85
import config from S4
zonca Dec 6, 2022
c47cfed
run in current folder
zonca Dec 15, 2022
8c34b0e
reran instrument model extraction, no changed compared to 2022 August
zonca Mar 15, 2023
bad5637
default resolution for Simons Observatory
zonca Mar 16, 2023
af24e33
put Nside and CAR resolution into instrument model
zonca Mar 18, 2023
808ace8
add reference to bandpass file
zonca Mar 19, 2023
5680ed1
downsample bandpasses
zonca Mar 21, 2023
ac54cc8
remove modeling nside, rename lmax_over_modeling_nside
zonca Mar 19, 2023
2a02f79
updated instrument model
zonca Mar 19, 2023
28bdd4c
imported components from CMB-S4 run
zonca Mar 19, 2023
8944979
Run websky and CMB at 4096 except tsz at 8192, co and mkd at 2048
zonca Mar 19, 2023
f0ea92c
cmb unlensed has no dipole
zonca Mar 21, 2023
2f1c283
set modeling nside for radio
zonca Mar 21, 2023
7c91119
update output file naming
zonca Mar 22, 2023
98ef722
band should only be the frequency, not the telescope
zonca Mar 22, 2023
32c882f
README
zonca Mar 22, 2023
bf9aef0
compute cl scripts
zonca Mar 22, 2023
c9bb54f
helpers for running jobs
zonca Mar 22, 2023
31c6bd4
debug script
zonca Mar 22, 2023
6c5b591
verification notebooks
zonca Mar 22, 2023
ea85bb9
logs and job scripts
zonca Mar 22, 2023
b363bb3
start to write up verification
zonca Mar 22, 2023
ab26ba6
change folder
zonca Mar 22, 2023
b5b26d6
verification plots
zonca Mar 22, 2023
1376cb4
replace verification notebooks with single one
zonca Mar 23, 2023
5f9b9fd
finalizing documentation
zonca Mar 23, 2023
e3ff58a
metadata in readme
zonca Mar 23, 2023
6f7e68a
delete old notebook
zonca Mar 23, 2023
96f6c02
combine maps script
zonca Mar 23, 2023
dd06e75
rename folder
zonca Mar 23, 2023
5f3e9a1
updated README
zonca Mar 23, 2023
7938c67
spellcheck
zonca Mar 23, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
67 changes: 67 additions & 0 deletions 202208_galactic_foregrounds/PLAN.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
Foreground simulation with realistic bandpasses and new Dust/Synchrotron models
===============================================================================

## Foreground models

The plan is to run 3 different sky models, optimistic/baseline/pessimistic, see the discussion in [this PySM 3 issue](https://github.com/galsci/pysm/issues/103#issuecomment-1081241879), for convenience here the 3 sets of models:

1. d9,s4,f1,a1,co1
2. d10,s5,f1,a1,co3
3. d12,s7,f1,a2,co3

Documentation reference:

* `d9` `d10` GNILC based models and `d12` MKD 3D layered dust model: https://pysm3.readthedocs.io/en/latest/models.html#dust
* Synchrotron models `s4` and `s5`: https://pysm3.readthedocs.io/en/latest/models.html#synchrotron
* CO: https://pysm3.readthedocs.io/en/latest/models.html#co-line-emission
* All other models are the same of PySM 2: https://pysm3.readthedocs.io/en/latest/models.html

There are 2 issues:

### Rotation to Equatorial

In previous runs I had created Equatorial versions of all the templates to avoid having to rotate the maps because it was not supported by libsharp, for this release we can stop using libsharp and instead use all the Galactic templates and then rotate to Equatorial at the last step when we are in spherical harmonics space for smoothing.

### Low resolution models

* d9, d10, s4, s5 and s7 are available up to 8192
* d12 to 2048
* f1, a1, a2 to 512, however we have an extrapolation to 4096 by @NicolettaK, see <https://portal.nersc.gov/project/cmb/so_pysm_models_data/>
* co? to 2048
zonca marked this conversation as resolved.
Show resolved Hide resolved

I suggest to not use the extrapolated map by @NicolettaK, because they use a different method from the new Dust and Synchrotron models. We plan in the future to have AME and Free-free maps at 8192 with small scales produced in a similar fashion to the `d10`/`s5` models.

I would run the maps in PySM at the highest available resolution, then in the smoothing process, we can do a `alm2map` at the target resolution.
Never use `hp.ud_grade`.
zonca marked this conversation as resolved.
Show resolved Hide resolved

## Bandpasses

Use bandpasses from the [Instrument model](https://github.com/simonsobs/instrument_model/tree/master/instrument_hardware/modeled_bandpasses)
zonca marked this conversation as resolved.
Show resolved Hide resolved

Using:

* *LF*: On-chip bandpass filters
* *MF*: On-chip bandpass filters + Gain effects + Beam effects (LAT/SAT)
* *UHF*: On-chip bandpass filters + Gain effects + Beam effects (LAT/SAT)

Will be reformatted and added to instrument model in text format like: <https://github.com/simonsobs/mapsims/tree/master/mapsims/data/simonsobs_instrument_parameters_2020.06>

## Beams

Will be extracted from `sotodlib` into a table in txt format and added to `mapsims`, like [`simonsobs_instrument_parameters_2020.06.tbl`](https://github.com/simonsobs/mapsims/blob/master/mapsims/data/simonsobs_instrument_parameters_2020.06/simonsobs_instrument_parameters_2020.06.tbl) in the last release.
zonca marked this conversation as resolved.
Show resolved Hide resolved

## Pixelization

Ideally we want to produce in 1 run only both HEALPix and CAR, once we have alms of the output map in equatorial, we can produce both final output HEALPix and CAR.

Need to implement this into `mapsims`.

Variable Nside: <https://github.com/simonsobs/mapsims/blob/master/mapsims/data/so_default_resolution.csv>
zonca marked this conversation as resolved.
Show resolved Hide resolved

## File format

FITS files, full sky, Equatorial, `uK_CMB`, IQU or I, single precision (float32)
[Add more metadata to FITS headers](https://github.com/simonsobs/map_based_simulations/issues/38)

Naming conventions, is there any standard SO naming convention we should follow?
Otherwise we can use the [same used for the last noise simulation](https://github.com/simonsobs/map_based_simulations/tree/master/202006_noise#available-maps)
zonca marked this conversation as resolved.
Show resolved Hide resolved