New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MTG: get projection and extent information from file #845
Commits on Nov 22, 2019
-
MTG: get projection and extent information from file
In the MTG FCI FDHSI L1C reader, get the projection coordinates and extent information from file. For the projection coordinates, get those from /data/mtg_geos_projection rather than from /state/processor, as is consistent with the documentation. The extent information was previously hardcoded but now obtained from data/channel/measured/x and data/channel/measured/y, which contain this information in radians. This commit fixes pytroll#840 although there are still some issues with the resulting image that need to be resolved.
-
FCI: Use pixel outer corners rather than centres
In FCI projection area extent, use the pixel outer corners rather than the centres.
-
TST: Expand mocking data on FCI projection
Newly the FCI reader is using new fields it wasn't using before. Make sure the test routines are mocking these fields so that the tests can run.
-
Replace f-string by regular string
Since we still support Python 2, replace f-string by regular string in FCI L1C FDHSI reader
-
Remove unused attribute from FCI FileHandler
Remove the unused ``_fallback_area_def`` attribute from the FCI L1C FDHSI FileHandler class.
-
DOC: Added info on how geolocation is done
Added to the reader module docstring information on how the geolocation is performed.
-
-
Disable netcdf load() workaround for xarray≥0.13
Earlier this year, I programmed a workaround for a bug in xarray. This bug got fixed in xarray 0.13. This commit disabled the workaround for sufficiently recent versions of xarray. Hopefully this will improve performance.
Commits on Nov 25, 2019
-
The FCI reader now uses the h5netcdf backend. See the comments on issue 972 for the rationale. The netcdf4 backend has a memory leak and even worse performance than the h5netcdf backend for opening and closing files many times, which the filehandler does. This addresses pytroll#972 although I'm not yet fully satisfied.
Commits on Nov 26, 2019
-
FCI: improve attribute reading
When reading attributes, do not access the data variable. Accessing the data variable will trigger netcdf_utils to actually open (and close) the netcdf file using xarray, causing unneccessary overhead. Instead, use the fact that the netcdf reader has cached this information. More caching may be needed. This commit is related to pytroll#972.
Commits on Nov 27, 2019
-
FCI performance: cache area extents between channels
For channels with the same resolution, don't recalculate the area extent as this is a performance hit. Instead, cache the area extent between channels with the same resolution.
-
FCI perf bugfix, don't share cache between instances
Fix a bug in the FCI performance optimisation, when caching area extents do not share this cache between different instances.
-
-
Fix nlines/ncols bug in FCI reader
FCI filehandler was setting nlines and ncols as an attribute, but this is channel dependent. Store as a dictionary instead. I don't know why this did not trigger any problems before the recent optimisations.
-
Bugfix, write ncols/nrows before returning cache
Bugfix in fci reader, now that I'm sometimes returning stuff from cache, make sure the side-effects such as setting other attributes has been carried out already...
-
FCI reader, don't needlessly store state
Needlessly storing the state is just asking for problems, as I experienced. Don't store ncols and nrows as attributes, instead pass them on between methods. This is not a property of a filehandler.
Commits on Nov 28, 2019
-
FCI, don't store area as attribute
In the FCI reader, do not store the area definition as a first-level instance attribute. This is different between channels.
-
FCI: move area caching one level up
Instead of caching the area extent, cache the full area definition.
Commits on Nov 29, 2019
-
FCI: do not duplicate changes from other branch
Do not duplicate the performance improvements from the other branch.
Commits on Dec 3, 2019
Commits on Dec 9, 2019
Commits on Dec 12, 2019
-
FCI, pass inverse flattening to AreaDefinition
In the FCI reader area definition, pass the inverse flattening, as included in the file, from the reader to the `AreaDefinition` into pyresample.
Commits on Dec 19, 2019
-
Add corrected scale factors for FCI projection
The scale factors and add offsets for the MTG FCI test data as published in 2019-09 are factually incorrect. This probably causes the differences between the pytroll and FCI geolocations. Until this is fixed from EUMETSATs side, hardcode corrected add_offset and scale_factor values. Also correct for an off-by-one error in the scale factors.
-
Add corrected scale factors for FCI projection
The scale factors and add offsets for the MTG FCI test data as published in 2019-09 are factually incorrect. This probably causes the differences between the pytroll and FCI geolocations. Until this is fixed from EUMETSATs side, hardcode corrected add_offset and scale_factor values. Similarly, there was a small error in the semi minor axis. Also correct for an off-by-one error in the scale factors.
-
Undo hardcoding FCI semi-minor axis
The FCI semi-minor axis correction does not improve anything, remove this hardcoding correction.
Commits on Jan 14, 2020
-
Merge branch 'fix-fci-projection' of github.com:gerritholl/satpy into…
… fix-fci-projection
-
-
-
FCI, complement mocking of variable attributes
Expand the mocking of variable attributes for the routine testing the FCI reader. One attribute was missing, and none were created in the "/attr/..." caching in which they are accessed by the reader.
Commits on Apr 1, 2020
Commits on Apr 2, 2020
-
FCI: Remove hardcoded parameters
Remove the hardcoded scale factor, add offset, and sweep. Those had been added to correct for errors in the 2019-09 release of FCI testdata, but should be fixed in the upcoming release, so should be no longer needed.
-
FCI: Remove unused hardcoded dictionary
From the FCI reader, remove an unused hardcoded dictionary containing extent information. This information was only used for debugging, but is redundant relative to what is available in the file, assuming a full disk image is square.
-
FCI: doc/comment fixes and change exception thrown
In the FCI reader, make minor fixes to comments and docstring, and replace a RuntimeError by a more specific ValueError if an invalid calibration key is passed.
Commits on Apr 3, 2020
-
Apparently, PEP 257 insists that the closing quotes for a single-line docstring must be on the same line as the rest of the docstring. I will abide by what is apparently the community standard, although I will hereby note my (minority?) preference for the "closing quotes on next line" alternative. Co-Authored-By: Martin Raspaud <martin.raspaud@smhi.se>
-
FCI: Remove empty line after method docstring
Remove an empty line immediately after a method docstring, in order to satisfy the flake8-docstrings plugin.