Satpy built-in composite for dust RGB (MSG/SEVIRI data) does not generate expected color pattern #896

anikfal · 2019-09-06T09:33:31Z

Among Satpy's built-in composites for MSG/SEVIRI data, "dust" which is supposed to generate dust RGB color image, does not show an expected image.
The standard MSG Dust RGB images should be like the image bellow:

But the result is totally different:

The SEVIRI data used in the code:
https://drive.google.com/file/d/1IKqTMndqR-huKO98Z8J5WYXTqP3OJjZs/view?usp=sharing

from satpy import Scene
from glob import glob
filenames = glob("W_XX-EUMETSAT-Darmstadt,VIS+IR+HRV+IMAGERY,MSG1+SEVIRI_C_EUMG_20190401090010.nc")
scn = Scene(reader="seviri_l1b_nc", filenames=filenames)
composite = 'dust'
#composite = 'night_fog'
scn.load([composite])
scn.show(composite)
#scn.save_datasets(writer='simple_image')

mraspaud · 2019-09-06T11:24:38Z

Hi,
Welcome and thanks for reporting this. I tried with the file you provided and other seviri file, and can't reproduce the problem. Can you tell us about what version of satpy, xarray, dask, pyresample and rasterio you are using ?

djhoese · 2019-09-06T12:47:51Z

AND how you are viewing the images?

anikfal · 2019-09-06T12:58:14Z

Hi and thanks for your consideration.

satpy: 0.16.0
xarray: 0.12.1
dask: 2.3.0
pyresample: 1.12.3
rasterio: 1.0.26

Furthermore, by using NCL, I manually calculated the brightness temperatures for the three SEVIRI channels (ch7, ch9, and ch10) used in generating dust RGB images. the BT values calculated by NCL for ch9 and ch10 seemed to be identical with the BT values calculated by Satpy. But the calculated BT values for ch7 were totally different.

djhoese · 2019-09-06T13:08:04Z

Any chance you have customized your Satpy installation at all? Do you have PPP_CONFIG_DIR set? Do you have any custom YAML files in your local directory?

anikfal · 2019-09-06T13:14:43Z

I have not created any composite configuration and custom files, and have not set PPP_CONFIG_DIR.

pnuu · 2019-09-06T13:41:11Z

And which python and numpy versions? Just a check that this isn't an integer division error or similar with Python 2 :-)

djhoese · 2019-09-06T13:51:54Z

@anikfal Some of the other pytroll community have tried this and are seeing different results depending on how they are showing the image. Do you get the same "bad" image if you save to a geotiff and open it?

simonrp84 · 2019-09-06T13:54:20Z

Hi @anikfal, this might be related to the library versions you are using.
I just tried in a jupyter notebook and saw the same result as you. Then I ran conda update --all and tried again. After the update the image looks as it should.

I get the correct output with these versions:
satpy: 0.16.1
xarray: 0.12.3
dask: 2.3.0
pyresample: 1.12.3
rasterio: 1.0.25

djhoese · 2019-09-06T13:56:04Z

Looks like some SEVIRI calibration issues were fixed in 0.16.1: #826

Try updating to satpy 0.16.1 and see if that fixes things.

anikfal · 2019-09-06T14:46:10Z

Problem solved. Thank you guys so mush.
According to #826, some terms in the seviri_l1b_nc.yaml file should be changed. one of them (ch7) incorporates in the calculation of Dust RGB composites.
The corrected Dust RGB image:

mraspaud · 2019-09-06T15:05:03Z

Thanks for reporting back!

gisgeo3 · 2021-09-17T17:14:52Z

Hi
I need help in create RGB for Meteosat.

djhoese · 2021-09-17T17:16:35Z

@gisgeo3 Do you mean the "dust" RGB or another one? This issue has been closed since 2019. It would be best if you created a new issue and gave more details about what you're trying to do, what isn't working as expected, and any other details you can provide.

gisgeo3 · 2021-09-17T17:41:54Z

djhoese
Hello dear
I am currently a PhD student majoring in climate and atmospheric sciences.
The topic of my thesis is about air mass, but I do not know how to create an RGB image of air mass, can you help me?

djhoese · 2021-09-17T18:02:03Z

@gisgeo3 Please create a new issue: https://github.com/pytroll/satpy/issues/new/choose

gisgeo3 · 2021-09-17T18:20:00Z

Is there anyone who can help me or can I contact them?

anikfal · 2021-09-17T18:37:30Z

Hi, If you're looking for sample codes, you don't have much trouble finding them on the internet. If you need any scientific information, you can ask it. Maybe someone can help. For your information, my thesis was based on the SEVIRI data.

…

On Fri, Sep 17, 2021, 22:50 gisgeo3 ***@***.***> wrote: Is there anyone who can help me or can I contact them? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#896 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACZR4Z6QQVIBAV7JSPXHS7LUCOBFZANCNFSM4IUG73ZQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

gisgeo3 · 2021-09-17T18:41:56Z

Can I contact you personally.

anikfal · 2021-09-17T18:46:32Z

Yeah, why not: ah.nikfal<at>gmail.com

…

On Fri, Sep 17, 2021, 23:12 gisgeo3 ***@***.***> wrote: Can I contact you personally. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#896 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACZR4ZZYW7XNVI773OGRB4TUCODX5ANCNFSM4IUG73ZQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

nur-idrissa · 2021-09-23T15:05:37Z

i mailed you. hope to get your assistance
thanks

anikfal · 2021-09-23T18:22:36Z

@nur-idrissa I responded to your email, but I think it's better to create issues to make it available to all the Satpy community.

nur-idrissa · 2021-10-09T08:12:35Z

hello dear family of satpy/github.
i followed the procedure above , i get the image correctly BUT WITH WARNING from proj package and when i try to resample the output to local/region.

the error warning is :
/work/home/fabin/.conda/envs/satpy/lib/python3.7/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
proj_string = self.to_proj4()
/work/home/fabin/.conda/envs/satpy/lib/python3.7/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
proj_string = self.to_proj4()
/work/home/fabin/.conda/envs/satpy/lib/python3.7/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
proj_string = self.to_proj4()
/work/home/fabin/.conda/envs/satpy/lib/python3.7/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
proj_string = self.to_proj4()

nur-idrissa · 2021-10-09T08:14:27Z

HOW DO I SOLVE this error?

and i want to show the boundary of countries. as shown in the previous comments. thank you all

nur-idrissa · 2021-10-09T08:15:40Z

pip list command shows proj package is avalaible in the environment.

nur-idrissa · 2021-10-09T08:17:41Z

mraspaud · 2021-10-11T07:10:26Z

@nur-idrissa the warning is nothing you need to worry about.
Regarding the coastline and borders (we call them overlays), for example:

overlay={
         'coast_dir': '/path/to/my/shapefiles/', 'overlays': {'coasts': {'outline': 'red'},
                                                              'borders': {'width': 0.5}}})
my_scene..save_dataset(overlay=overlay)

Also, in the future, please create a new issue if your problem is not directly related to an existing one.

mraspaud closed this as completed Sep 6, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Satpy built-in composite for dust RGB (MSG/SEVIRI data) does not generate expected color pattern #896

Satpy built-in composite for dust RGB (MSG/SEVIRI data) does not generate expected color pattern #896

anikfal commented Sep 6, 2019

mraspaud commented Sep 6, 2019 •

edited

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019 •

edited

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019

pnuu commented Sep 6, 2019

djhoese commented Sep 6, 2019

simonrp84 commented Sep 6, 2019

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019

mraspaud commented Sep 6, 2019

gisgeo3 commented Sep 17, 2021

djhoese commented Sep 17, 2021

gisgeo3 commented Sep 17, 2021

djhoese commented Sep 17, 2021

gisgeo3 commented Sep 17, 2021

anikfal commented Sep 17, 2021 via email

gisgeo3 commented Sep 17, 2021

anikfal commented Sep 17, 2021 via email

nur-idrissa commented Sep 23, 2021

anikfal commented Sep 23, 2021 •

edited

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

mraspaud commented Oct 11, 2021

Satpy built-in composite for dust RGB (MSG/SEVIRI data) does not generate expected color pattern #896

Satpy built-in composite for dust RGB (MSG/SEVIRI data) does not generate expected color pattern #896

Comments

anikfal commented Sep 6, 2019

mraspaud commented Sep 6, 2019 • edited

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019 • edited

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019

pnuu commented Sep 6, 2019

djhoese commented Sep 6, 2019

simonrp84 commented Sep 6, 2019

djhoese commented Sep 6, 2019

anikfal commented Sep 6, 2019

mraspaud commented Sep 6, 2019

gisgeo3 commented Sep 17, 2021

djhoese commented Sep 17, 2021

gisgeo3 commented Sep 17, 2021

djhoese commented Sep 17, 2021

gisgeo3 commented Sep 17, 2021

anikfal commented Sep 17, 2021 via email

gisgeo3 commented Sep 17, 2021

anikfal commented Sep 17, 2021 via email

nur-idrissa commented Sep 23, 2021

anikfal commented Sep 23, 2021 • edited

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

nur-idrissa commented Oct 9, 2021

mraspaud commented Oct 11, 2021

mraspaud commented Sep 6, 2019 •

edited

anikfal commented Sep 6, 2019 •

edited

anikfal commented Sep 23, 2021 •

edited