Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor SCMI writer to be dask friendly #481

Merged
merged 3 commits into from Nov 1, 2018

Conversation

djhoese
Copy link
Member

@djhoese djhoese commented Oct 31, 2018

The previous version forced the calculation of all datasets. It now separates all the logic out to create the output NetCDF files during the dask computation steps. This PR also includes support for RGB datasets by splitting the data per-band in to separate files.

  • Tests added
  • Tests passed
  • Passes git diff origin/master -- "*py" | flake8 --diff

Includes support for RGB datasets
@djhoese djhoese added enhancement code enhancements, features, improvements component:writers labels Oct 31, 2018
@djhoese djhoese self-assigned this Oct 31, 2018
'test',
'test',
'test',
proj_dict=proj4_str_to_dict('+proj=lcc +datum=WGS84 +ellps=WGS84 +lon_0=-95. +lat_0=25 +lat_1=25 +units=m +no_defs'),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E501 line too long (129 > 120 characters)

@coveralls
Copy link

coveralls commented Oct 31, 2018

Coverage Status

Coverage increased (+0.1%) to 74.257% when pulling 0537a4d on djhoese:feature-scmi-rgbs into 7c8cdc4 on pytroll:master.

@codecov
Copy link

codecov bot commented Oct 31, 2018

Codecov Report

Merging #481 into master will increase coverage by 0.1%.
The diff coverage is 88.79%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master     #481     +/-   ##
=========================================
+ Coverage   74.15%   74.25%   +0.1%     
=========================================
  Files         136      136             
  Lines       18070    18114     +44     
=========================================
+ Hits        13400    13451     +51     
+ Misses       4670     4663      -7
Impacted Files Coverage Δ
satpy/tests/writer_tests/test_scmi.py 95.32% <100%> (+1.2%) ⬆️
satpy/writers/scmi.py 74% <86.73%> (+1.82%) ⬆️
satpy/readers/viirs_compact.py 14.22% <0%> (+0.35%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7c8cdc4...0537a4d. Read the comment docs.

@djhoese djhoese merged commit 8667ef9 into pytroll:master Nov 1, 2018
@djhoese djhoese deleted the feature-scmi-rgbs branch November 1, 2018 13:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:writers enhancement code enhancements, features, improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants