EMERGENCY: ARFC turning off assimilation of OMP data

[KateFriedman-NOAA]

Need to use operations branch to hand off emergency change for ops.

Created operations_OMPS branch off operations branch prior to commit for updated bufr station file.

[KateFriedman-NOAA]

Temporary fix made in production resulting in gfsv15.2.7.1. NCO did the following (from email with Russ, Diane also confirmed through chat):

- update global_ozinfo.txt in a temporary version /gpfs/dell1/nco/ops/nwprod/gfs.v15.2.7.1
- update /gpfs/dell1/nco/ops/nwprod/versions/gfs.ver to point to  v15.2.7.1
- later:  revert back to version v15.2.7 once OMPS is restore to usable state

There's no emergency RFC message in the SPALOG yet.   It should show up later.  Tomorrow's posting of the SDMLOG for today should also reflect today's changes.

From SDM LOG:

NESDIS CONTACT / DEGRADED VIIRS AND CRIS DATA

16a. 1641Z - NESDIS PDA's Donna Mcnamara called to report that
the quality of VIIRS and CrIS data could be severely degraded
because of a calibration problem, and they don't think the
problem is going to be resolved until after the holiday weekend.
Donna was concerned about the bad data getting into the models.
Relayed this information to SPA and Dataflow for awareness.

16b. 1820Z - NESDIS's Ricky visited the SDM desk to discuss the
option to turn the data off, but he wanted to know how this
would impact model production. Reached out to the SPA Team. SPA
Diane will reach out to EMC.

16c. 1825Z - SPA Holly reported that other National Centers also
receive CrIS data.

16d. 1830Z - NESDIS's Ricky reported they will know more
information about a possible fix by 2pm EST. It was agreed that
any decisions will wait until then.

16e. 1838Z - SPA Diane relayed the info to EMC's Vijay
Tallapragada and Daryl Kleist. They are going to consider
options.

16f. 1938Z - EMC's Daryl is going to reach out to NESDIS for
more details.

16g. 1938Z - NESDIS sent notification that they have a fix ready
to deploy. Forwarded notification to Daryl. NESDIS's Ricky
visited the SDM desk to report they are tabling the idea of
turning off the data for now. SPA Diane also forwarded the
notification to EMC's Vijay.

16h. 2110Z - Discussed an ARFC with IDSB Chief Carissa and Diane
an ARFC to put the data into monitor mode as Daryl reports it is
degrading the model. Once the data has been fixed and EMC
confirms no model degradation, the data will be put back into
normal operations. SDM approved. (KAL)

16i. 2203Z - Diane began the ARFC work. (KAL)

16j. 2308Z - ESPC reported a fix has been implemented and all
products VIIRS SDR products are nominal once again. (KAL)

16k. 2318Z - ARFC work completed and will take effect for the
18Z GDAS. (KAL)

[KateFriedman-NOAA]

From today's SDMLOG:

1w. 1732Z - SPA Diane emailed "Beginning work on rollback of
ARFC - GFS/GDAS emergency fix to monitor OMPS data from NPP
satellite (from Friday Jan 17)." 1738Z - Complete.

[KateFriedman-NOAA]

Closing ticket now that rollback is complete.

[KateFriedman-NOAA]

From the January 24th RFC memo:

RFC 6460 – gfs v15.2.7.1 – On WCOSS, changed the OMPS NPP data from
active assimilation to monitor mode. This change was made because an anomaly
in the VIIRS SDR reflective solar bands (RSB) calibration was affecting the Ozone
Mapping and Profiler Suite (OMPS) SDR with large errors in the Solar Zenith
Angles. This was implemented on January 17 at 2200Z and then rolled back on
January 21 after the data quality was restored.

[KateFriedman-NOAA]

Deleted "operations_OMPS" branch.