Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Stage to compute CL shear individual profiles and stacked profile, using CLMM functionalities #325

Draft
wants to merge 45 commits into
base: master
Choose a base branch
from
Draft

Stage to compute CL shear individual profiles and stacked profile, using CLMM functionalities #325

wants to merge 45 commits into from

Commits on Jul 19, 2023

  1. Start new ensemble profile stage

    @combet
    combet committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8cde3d1 View commit details
    Browse the repository at this point in the history

  2. remove weights computation from select.py

    @combet
    combet committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    7f1e876 View commit details
    Browse the repository at this point in the history

  3. putting data folder back in

    @combet
    combet committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    50024fd View commit details
    Browse the repository at this point in the history

  4. reproduced Celine's crossing pipeline diagram

    @cavestruz
    cavestruz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    d708b6b View commit details
    Browse the repository at this point in the history

  5. added cluster_shear_profiles as one of the inputs to CLClusterEnsembl… 

    …eProfiles
    @cavestruz
    cavestruz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    69a6e93 View commit details
    Browse the repository at this point in the history

  6. added nersc version to notebook

    @cavestruz
    cavestruz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8f5443d View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into issue/307/CL_individual_profile_stage

    @cavestruz
    cavestruz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    b5727aa View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Merge branch 'master' into issue/307/CL_individual_profile_stage

    @cavestruz
    cavestruz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    0c76603 View commit details
    Browse the repository at this point in the history

  2. merged the NERSC instructions in the notebook from master and now hav… 

    …e a version of the yml file to have an additional pipeline stage visualized
    @cavestruz
    cavestruz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    90d1b51 View commit details
    Browse the repository at this point in the history

  3. reorgnise new stuff in to new files

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    576ca44 View commit details
    Browse the repository at this point in the history

  4. fixing merge conflict

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    8acd286 View commit details
    Browse the repository at this point in the history

  5. fix merge conflict

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    81d972f View commit details
    Browse the repository at this point in the history

  6. one more fix

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    d0230f4 View commit details
    Browse the repository at this point in the history

  7. rename select.py to sources_select_compute.py to perform all individu… 

    …al galaxies computation in the same stage
    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    8d644fa View commit details
    Browse the repository at this point in the history

  8. compute tan and cross component of individual galaxies

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    acbcccc View commit details
    Browse the repository at this point in the history

  9. Fix galaxy source selection to be per cluster

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    8b5ebb0 View commit details
    Browse the repository at this point in the history

  10. Fix sigma_c keyword

    @combet
    combet committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    743d930 View commit details
    Browse the repository at this point in the history

  11. modification to make_ensemble_profile so we can access source galaxy … 

    …info per cluster and construct profile. still have bug for writing
    @cavestruz
    cavestruz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    9a075a0 View commit details
    Browse the repository at this point in the history

  12. no major change

    @cavestruz
    cavestruz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    8ac846e View commit details
    Browse the repository at this point in the history

  13. Modified step 3 to have appropriate input/output files available

    @cavestruz
    cavestruz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    6efd50a View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. needed to add a colon

    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    0210cb4 View commit details
    Browse the repository at this point in the history

  2. starting code for getting source galaxy redshifts per cluster

    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    f62a426 View commit details
    Browse the repository at this point in the history

  3. added some rough lines of code to read in source galaxy data and pull… 

    … redshifts of those corresponding to cluster background sources
    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    aaf9846 View commit details
    Browse the repository at this point in the history

  4. aiming to replicate the source reading from sources_select_compute.py… 

    … in make_ensemble_profile.py, and we need to have several other files as inputs to this pipeline stage
    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    80ed6b9 View commit details
    Browse the repository at this point in the history

  5. Actually didn't need to access source photoz from the cluster backgro… 

    …und galaxy indices in order to calculate the shear profiles. But we may need to know how to do that
    @combet
    combet committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    4f18eac View commit details
    Browse the repository at this point in the history

  6. Started adding HDF5 save for the profile. Probbaly need to output ind… 

    …ividual columns of the GCData CLMM table
    @combet
    combet committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    cea36a8 View commit details
    Browse the repository at this point in the history

  7. added all necessary pieces for the output file in the run portion of … 

    …this pipeline stage. Still need to check and change the collect method.
    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    259f9ce View commit details
    Browse the repository at this point in the history

  8. minor bugs fixed, now need to understand necessary datastructure for … 

    …collecting from processes
    @cavestruz
    cavestruz committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    bdf0b72 View commit details
    Browse the repository at this point in the history

  9. Save HDF5 file of the individual profiles computed by CLMM

    @combet
    combet committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    e318d76 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. Fix indexing of the catalog group. All profiles are correctly populated

    @combet
    combet committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    c24dfad View commit details
    Browse the repository at this point in the history

  2. made modiications to the collect method in this new stage for profile… 

    … sending and gathering
    @cavestruz
    cavestruz committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    d5007cd View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Minor thing

    @combet
    combet committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    b492ffb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into issue/307/CL_individual_profile_stage

    @combet
    combet committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    970ff4c View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Change column name source_bin --> bin so following the change merged … 

    …in master from PR #317 (simplify tomography files and mappers)
    @combet
    combet committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    2417c76 View commit details
    Browse the repository at this point in the history

  2. Comment out line currently giving error when importing txpipe

    @combet
    combet committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    e9d1787 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. small test

    @combet
    combet committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    efe8f53 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into issue/307/CL_individual_profile_stage

    @combet
    combet committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    db604f3 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. First attempt to build CLMM cluster ensemble object and compute stack… 

    …ed profile. Probable problem with the weights W_l to be investigated
    @combet
    combet committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    446c980 View commit details
    Browse the repository at this point in the history

  2. Reorder

    @combet
    combet committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    f7f5f5f View commit details
    Browse the repository at this point in the history

  3. Switching to pre-defined radial bins

    @combet
    combet committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    ab67fa9 View commit details
    Browse the repository at this point in the history

  4. Extend to 10 Mpc to avoid empty bins

    @combet
    combet committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    20517c1 View commit details
    Browse the repository at this point in the history

  5. Comment out MPI-specific code and add explanatory comments for the ne… 

    …w code added, that uses CLMM cluster object and CLMM ensemble object
    @combet
    combet committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    b9b5d30 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. Update select.py 

    Add old suffixe to outdated ClClusterShearCatalogs class
    @marina-ricci
    marina-ricci committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    403a5d0 View commit details
    Browse the repository at this point in the history

  2. Update make_ensemble_profile.py 

    Added line to make it output a file with the cluster ensemble profile
    @marina-ricci
    marina-ricci committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    77a4665 View commit details
    Browse the repository at this point in the history

  3. Update make_ensemble_profile.py 

    Added covariance (sample covariance).
    @marina-ricci
    marina-ricci committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    9fc9f83 View commit details
    Browse the repository at this point in the history