open-data-registry/datasets/noaa-goes.yaml at main · awslabs/open-data-registry · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
Name: "NOAA Geostationary Operational Environmental Satellites (GOES) 16, 17, 18 & 19"
Description: |
  <br/>
  <br/>
  NEW GOES-19 Data!! On April 4, 2025 at 1500 UTC, the GOES-19 satellite will be declared the Operational GOES-East satellite. All products and services, including NODD, for GOES-East will transition to GOES-19 data at that time. GOES-19 will operate out of the GOES-East location of 75.2°W starting on April 1, 2025 and through the operational transition. Until the transition time and during the final stretch of Post Launch Product Testing (PLPT), GOES-19 products are considered non-operational regardless of their validation maturity level. Shortly following the transition of GOES-19 to GOES-East, all data distribution from GOES-16 will be turned off. GOES-16 will drift to the storage location at 104.7°W. GOES-19 data should begin flowing again on April 4th once this maneuver is complete.
  <br/>
  <br/>
  NEW GOES 16 Reprocess Data!! The reprocessed GOES-16 ABI L1b data mitigates systematic data issues (including data gaps and image artifacts) seen in the Operational products, and improves the stability of both the radiometric and geometric calibration over the course of the entire mission life. These data were produced by recomputing the L1b radiance products from input raw L0 data using improved calibration algorithms and look-up tables, derived from data analysis of the NIST-traceable, on-board sources. In addition, the reprocessed data products contain enhancements to the L1b file format, including limb pixels and pixel timestamps, while maintaining compatibility with the operational products. The datasets currently available span the operational life of GOES-16 ABI, from early 2018 through the end of 2024. The Reprocessed L1b dataset shows improvement over the Operational L1b products but may still contain data gaps or discrepancies. Please provide feedback to Dan Lindsey (dan.lindsey@noaa.gov) and Gary Lin (guoqing.lin-1@nasa.gov). More information can be found in the [GOES-R ABI Reprocess User Guide](https://github.com/NOAA-Big-Data-Program/nodd-data-docs/blob/main/GOES/GOES-R_ABI_Reprocessed_L1b_User_Guide-v1.1.pdf).
  <br/>
  <br/>
  NOTICE: As of January 10th 2023, GOES-18 assumed the GOES-West position and all data files are deemed both operational and provisional, so no ‘preliminary, non-operational’ caveat is needed. GOES-17 is now offline, shifted approximately 105 degree West, where it will be in on-orbit storage. GOES-17 data will no longer flow into the GOES-17 bucket. Operational GOES-West products can be found in the GOES-18 bucket.
  <br/>
  <br/>
  GOES satellites (GOES-16, GOES-17, GOES-18 & GOES-19) provide continuous weather imagery and
  monitoring of meteorological and space environment data across North America.
  GOES satellites provide the kind of continuous monitoring necessary for
  intensive data analysis. They hover continuously over one position on the surface.
  The satellites orbit high enough to allow for a full-disc view of the Earth. Because
  they stay above a fixed spot on the surface, they provide a constant vigil for the
  atmospheric "triggers" for severe weather conditions such as tornadoes, flash floods,
  hailstorms, and hurricanes. When these conditions develop, the GOES satellites are able
  to monitor storm development and track their movements. SUVI products available in both NetCDF and FITS.
Documentation: https://github.com/NOAA-Big-Data-Program/nodd-data-docs/tree/main/GOES
Contact:  |
  <br/>
  For questions related to specific GOES Products, please visit the "[GOES-R website](https://www.ncei.noaa.gov/products/satellite/goes-r-series)" and navigate to the Help section.
  <br/>
  For any questions regarding data delivery or any general questions regarding the NOAA Open Data Dissemination (NODD) Program, email the NODD Team at nodd@noaa.gov.
  <br /> We also seek to identify case studies on how NOAA data is being used and will be featuring those stories in joint publications and in upcoming events. If you are interested in seeing your story highlighted, please share it with the NODD team by emailing nodd@noaa.gov
ManagedBy: "[NOAA](http://www.noaa.gov/)"
UpdateFrequency: New data is added as soon as it's available
Collabs:
  ASDI:
    Tags:
      - satellite imagery
Tags:
  - aws-pds
  - agriculture
  - geospatial
  - weather
  - earth observation
  - meteorological
  - disaster response
  - satellite imagery
License: NOAA data disseminated through NODD are open to the public and can be used as desired.<br/> <br/>NOAA makes data openly available to ensure maximum use of our data, and to spur and encourage exploration and innovation throughout the industry. NOAA requests attribution for the use or dissemination of unaltered NOAA data. However, it is not permissible to state or imply endorsement by or affiliation with NOAA. If you modify NOAA data, you may not state or imply that it is original, unaltered NOAA data.
Resources:
  - Description: GOES-19 imagery and metadata
    ARN: arn:aws:s3:::noaa-goes19
    Region: us-east-1
    Type: S3 Bucket
    Explore:
    - '[Browse Bucket](https://noaa-goes19.s3.amazonaws.com/index.html)'
  - Description: New data notifications for GOES-19, only Lambda and SQS protocols allowed
    ARN: arn:aws:sns:us-east-1:123901341784:NewGOES19Object
    Region: us-east-1
    Type: SNS Topic
  - Description: GOES-18 imagery and metadata
    ARN: arn:aws:s3:::noaa-goes18
    Region: us-east-1
    Type: S3 Bucket
    Explore:
    - '[Browse Bucket](https://noaa-goes18.s3.amazonaws.com/index.html)'
  - Description: New data notifications for GOES-18, only Lambda and SQS protocols allowed
    ARN: arn:aws:sns:us-east-1:123901341784:NewGOES18Object
    Region: us-east-1
    Type: SNS Topic
  - Description: GOES-16 imagery and metadata
    ARN: arn:aws:s3:::noaa-goes16
    Region: us-east-1
    Type: S3 Bucket
    Explore:
    - '[Browse Bucket](https://noaa-goes16.s3.amazonaws.com/index.html)'
  - Description: New data notifications for GOES-16, only Lambda and SQS protocols allowed
    ARN: arn:aws:sns:us-east-1:123901341784:NewGOES16Object
    Region: us-east-1
    Type: SNS Topic
  - Description: GOES-17 imagery and metadata
    ARN: arn:aws:s3:::noaa-goes17
    Region: us-east-1
    Type: S3 Bucket
    Explore:
    - '[Browse Bucket](https://noaa-goes17.s3.amazonaws.com/index.html)'
  - Description: New data notifications for GOES-17, only Lambda and SQS protocols allowed
    ARN: arn:aws:sns:us-east-1:123901341784:NewGOES17Object
    Region: us-east-1
    Type: SNS Topic
DataAtWork:
  Tutorials:
    - Title: Visualize GOES-16 in Python using Xarray
      URL: https://github.com/HamedAlemo/visualize-goes16
      AuthorName: Hamed Alemohammad
      AuthorURL: https://www.linkedin.com/in/hamedalemohammad/
    - Title: Comparison reading GOES-R data from AWS S3 in netCDF versus zarr
      URL: https://nbviewer.jupyter.org/github/oceanhackweek/ohw-tutorials/blob/OHW20/10-satellite-data-access/goes-cmp-netcdf-zarr.ipynb
      AuthorName: Chelle Gentemann
      AuthorURL: http://www.faralloninstitute.org/chelle
    - Title: NOAA GOES16 Julia Jupyter Notebook Example
      URL: https://github.com/awslabs/amazon-asdi/tree/master/examples/goes16-precip-julia
      AuthorName: Peter Schmiedeskamp
      Services:
        - AWS CloudFormation
        - Amazon EC2
        - Amazon SageMaker
    - Title: Processing GOES-16 data with Dask & AWS Fargate
      URL: https://nbviewer.jupyter.org/github/awslabs/amazon-asdi/blob/main/examples/dask/notebooks/goes16_dask.ipynb
      AuthorName: Zac Flamig
      Services:
        - AWS CloudFormation
        - AWS Fargate
        - Amazon SageMaker
    - Title: Forecasting Hurricane Tracks with TensorFlow and data from AWS S3
      URL: https://github.com/M00NSH0T/Hurricanes/tree/master/2021%20update
      AuthorName: Kyle Archie
  Tools & Applications:
    - Title: GOES-2-go is a python package for downloading and plotting plotting GOES data.
      URL: https://github.com/blaylockbk/goes2go
      AuthorName: Brian K. Blaylock
      AuthorURL: https://www.linkedin.com/in/blaylockbk/
    - Title: Modern Data Platform Orchestration with Dagster Software-Defined Assets
      URL: https://medium.com/p/6a7182b0d834
      AuthorName: Adebayo Adejare
      AuthorURL: https://medium.com/@adebayoadejare
    - Title: GOES Data Explorer
      URL: https://coliveir-aer.github.io/goes-data-explorer/
      AuthorName: Craig Oliveira
  Publications:
    - Title: Observations of lightning in relation to transitions in volcanic activity during the 3 June 2018 Fuego Eruption
      URL: https://www.nature.com/articles/s41598-020-74576-x
      AuthorName: Christopher J. Schultz, Virginia P. Andrews, Kimberly D. Genareau, and Aaron R. Naeger
    - Title: Comparison of Lightning Forecasts from the High-Resolution Rapid Refresh Model to Geostationary Lightning Mapper Observations
      URL: https://doi.org/10.1175/WAF-D-19-0141.1
      AuthorName: Brian K. Blaylock, and John D. Horel
    - Title: Billions of Birds Migrate. Where Do They Go?
      URL: https://www.nationalgeographic.com/magazine/2018/03/bird-migration-interactive-maps/
      AuthorName: National Geographic
    - Title: Embracing the cloud for climate research
      URL: https://aws.amazon.com/blogs/publicsector/embracing-the-cloud-for-climate-research/
      AuthorName: North Carolina State University’s North Carolina Institute for Climate Studies
    - Title: Solar irradiance forecasting for the solar powered future
      URL: https://aws.amazon.com/blogs/publicsector/solcast-solar-irradiance-forecasting-for-the-solar-powered-future/
      AuthorName: Solcast
    - Title: Beginner’s Guide to GOES-R Series Data
      URL: https://noaa-goes16.s3.amazonaws.com/Beginners_Guide_to_GOES-R_Series_Data.pdf
      AuthorName: Danielle Losos
    - Title: GOES Quick Guides (Spanish)
      URL: https://github.com/NOAA-Big-Data-Program/bdp-data-docs/tree/main/GOES/QuickGuides/Spanish
      AuthorName: Anthony Segura García
    - Title: "SunCast: Solar Irradiance Nowcasting from Geosynchronous Satellite Data"
      URL: https://arxiv.org/pdf/2201.06173.pdf
      AuthorName: Dhileeban Kumaresan, Richard Wang, Ernesto Martinez, Richard Cziva, Alberto Todeschini, Colorado J Reed, Hossein Vahabi
    - Title: The Use of Composite GOES-R Satellite Imagery to Evaluate a TC Intensity and Vortex Structure Forecast by an FV3GFS-Based Hurricane Forecast Model
      URL: https://doi.org/10.3390/atmos13010126
      AuthorName: Shaowu Bao, Zhan Zhang, Evan Kalina, and Bin Liu
    - Title: Imaging Considerations From a Geostationary Orbit Using the Short Wavelength Side of the Mid-Infrared Water Vapor Absorption Band
      URL: https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2021EA002080
      AuthorName: N.B. Miller, M.M. Gunshor, A.J. Merrelli, T.S. L'Ecuyer, T.J. Schmit, J.J. Gerth, N.J. Gordillo
    - Title: Identifying the Causes of Pyrocumulonimbus (PyroCb)
      URL: https://arxiv.org/pdf/2211.08883.pdf
      AuthorName: Emiliano Díaz Salas-Porras, Kenza Tazi, Ashwin Braude, Daniel Okoh, Kara D. Lamb, Duncan Watson-Parris, Paula Harder, and Nis Meinert