Work for LSST demo #27

pkgw · 2020-10-12T17:33:15Z

No description provided.

…tiling

If the cascade was starting at a sufficiently deep level, the ready queue could simply fill up before any quartets were completed. Just allow it to become unboundedly large.

This reads an image, allows the caller to modify it, and then rewrites it. The key is that this uses file locking to make sure that multiple processes don't operate on the same tile at the same time, as might happen when doing a parallelized multi-segment tiling operation.

Now that we have centralized the image I/O stuff, we don't need to disambiguate the method names anymore.

Azure's conda has updated to Python 3.9, but astropy isn't yet available for it, so we need to explicitly specify an older version to get it for the docs and coverage builds.

codecov · 2020-10-12T17:48:31Z

Codecov Report

Merging #27 into master will decrease coverage by 6.92%.
The diff coverage is 12.95%.

@@            Coverage Diff             @@
##           master      #27      +/-   ##
==========================================
- Coverage   86.02%   79.09%   -6.93%     
==========================================
  Files          12       13       +1     
  Lines        1882     2057     +175     
==========================================
+ Hits         1619     1627       +8     
- Misses        263      430     +167

Impacted Files	Coverage Δ
toasty/multi_wcs.py	`0.00% <0.00%> (ø)`
toasty/image.py	`71.87% <6.66%> (-4.69%)`	⬇️
toasty/study.py	`84.34% <12.50%> (-11.66%)`	⬇️
toasty/pyramid.py	`85.21% <35.71%> (-6.13%)`	⬇️
toasty/merge.py	`95.72% <100.00%> (+0.11%)`	⬆️
toasty/toast.py	`98.87% <100.00%> (ø)`

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fe19e1d...8fb101f. Read the comment docs.

pkgw · 2020-10-12T17:57:10Z

This puts a bit of a ding in our code coverage, but we can't test it effectively until reproject learns how to optimize WCS given only shapes (astropy/reproject#242). I want to get these changes merged in so that I can start working on the next set of features, so I'm gonna take the hit.

pkgw added 12 commits October 8, 2020 08:44

toasty/image.py: add update_into_maskable_buffer() for multi-segment …

5b4921a

…tiling

toasty/merge.py: avoid annoying warnings in averaging_merger

17108d4

toasty/merge.py: avoid deadlocking for large cascade operations

bfd0030

If the cascade was starting at a sufficiently deep level, the ready queue could simply fill up before any quartets were completed. Just allow it to become unboundedly large.

toasty/pyramid.py: fix the "masked" mode for reading images

d0529c7

toasty/study.py: add compute_for_subimage()

e6ac1c0

Record new filelock dependency.

b9eb1f4

RELEASE_PROCESS.md: superseded by toasty

5ac9ee1

toasty/pyramid.py: {read,write}_toasty_image => {read,write}_image

f617e24

Now that we have centralized the image I/O stuff, we don't need to disambiguate the method names anymore.

toasty/multi_wcs.py: start building multi-generic-WCS tiling

94d8c50

toasty/multi_wcs.py: fix vertical flip, I hope

73c69b6

ci/azure-build-and-test.yml: fix builds as Python 3.9 rolls out

8fb101f

Azure's conda has updated to Python 3.9, but astropy isn't yet available for it, so we need to explicitly specify an older version to get it for the docs and coverage builds.

pkgw merged commit c707cae into WorldWideTelescope:master Oct 12, 2020

pkgw deleted the lsst-demo branch October 12, 2020 17:57

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Work for LSST demo #27

Work for LSST demo #27

pkgw commented Oct 12, 2020

codecov bot commented Oct 12, 2020

pkgw commented Oct 12, 2020

Work for LSST demo #27

Work for LSST demo #27

Conversation

pkgw commented Oct 12, 2020

codecov bot commented Oct 12, 2020

Codecov Report

pkgw commented Oct 12, 2020