Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add degridding mode which utilises pfb-clean universal models. #286

Open
wants to merge 51 commits into
base: main
Choose a base branch
from

Conversation

JSKenyon
Copy link
Collaborator

This PR is a WIP which integrates basic degridding functionality into QuartiCal via ducc0 and the prototype universal model format produced by pfb-clean model2comps.

Initial experiments are promising (model visibilities are produced and calibration runs through). There are still a large number of sharp edges and missing features but this PR will allow us to keep track of developments.

JSKenyon and others added 30 commits July 26, 2023 11:15
… required. (#285)

* Fix version drift.

* Bump to 0.2.0

* Use nearest-neighbour interpolation for points requiring extrapolation.
* Fix version drift.

* Bump to 0.2.0

* Inspect envvar for scheduler address when one isn't specified.

* Encode environment varraible as ascii.

* Simplify.
* Fix version drift.

* Bump to 0.2.0

* Initial commit of basic plotting functionality.

* Change naming convention.

* Improve transform argument.

* Simplify transform selection.

* Add rudimentary time and frequency selection.

* Checkpoint ploter changes. Can now handle scans and spws, but is very slow.

* More work on plotter - can now plot datasets in parallel.

* Some tidying.

* Slightly improve plot speed. Dominant cost is still saving the figures.

* Commit some minor changes which speed up figure saving.

* Lots of tiny fixes.

* Tiny cosmetic changes.

* Add custom tick formatter so that plots are the same size regardless.

* Add matplotlib dependency.

* Rework construction of plotting dictionary. Add a few utility functions which will likely be useful in other places in QC.

* Rename variable to avoid confusion.

* Fix bug affecting recursive grouping.

* Avoid copies in grouping code.

* Checkpoint work on extending functionality.

* Make plotter more powerful. Add colourization option. Begin simplifying interface.

* Allow user specification of colourmap.

* Add plotsize parameter.
JSKenyon and others added 17 commits August 30, 2023 12:16
* Fix version drift.

* Bump to 0.2.0

* Fix #293.
* Fix version drift.

* Bump to 0.2.0

* Add optional label and single field selection to backup app

* remove item instead of pop@index

* do not .remove() from xds_list

* Simplify using some existing functionality.

---------

Co-authored-by: JSKenyon <jonathan.simon.kenyon@gmail.com>
Co-authored-by: landmanbester <lbester@ska.ac.za>
* Fix version drift.

* Bump to 0.2.0

* Setting MAD threshold to zero will disable flagging on a given statistic.
* Fix version drift.

* Bump to 0.2.0

* Disable flagging based on off-diagonal correlations in the mad flagger by default. This should make the mad flagger less agressive on data with unmodelled polarised emission.
Base automatically changed from v0.2.1-dev to main January 30, 2024 06:46
@JSKenyon JSKenyon changed the base branch from main to v0.2.2-dev January 30, 2024 07:39
Base automatically changed from v0.2.2-dev to main February 2, 2024 11:21
@JSKenyon JSKenyon changed the base branch from main to v0.2.3-dev February 2, 2024 11:23
Base automatically changed from v0.2.3-dev to main April 22, 2024 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants