Skip to content

Latest commit

 

History

History
145 lines (127 loc) · 6.01 KB

index.rst

File metadata and controls

145 lines (127 loc) · 6.01 KB
Raw

MET version

Developed by the Developmental Testbed Center, Boulder, CO

image

History

The Model Evaluation Tools (MET) were developed by the Developmental Testbed Center (DTC) and released in January 2008. The goal of the tools was to provide the community with a platform-independent and extensible framework for reproducible verification. The DTC partners, including NCAR, NOAA, and the USAF, decided to start by replicating the NOAA EMC (see list of acronyms below) Mesoscale Branch verification package, called VSDB. In the first release, MET included several pre-processing, statistical, and analysis tools to provide the same primary functionality as the EMC VSDB system, and also included a spatial verification package called MODE.

Over the years, MET and VSDB packages grew in complexity. Verification capability at other NOAA laboratories, such as ESRL, were also under heavy development. An effort to unify verification capability was first started under the HIWPP project and led by NOAA ESRL. In 2015, the NGGPS Program Office started working groups to focus on several aspects of the next gen system, including the Verification and Validation Working Group. This group made the recommendation to use MET as the foundation for a unified verification capability. In 2016, NCAR and GSD leads visited EMC to gather requirements. At that time, the concept of METplus was developed as it extends beyond the original code base. It was originally MET+ but several constraints have driven the transition to the use of METplus. METplus is now the unified verification, validation, and diagnostics capability for NOAA's UFS and a component of NCAR's SIMA modeling frameworks. It is being actively developed by NCAR, ESRL, EMC and is open to community contributions.

METplus Concept

METplus is the overarching, or umbrella, repository and hence framework for the Unified Forecast System verification capability. It is intended to be extensible through adding additional capability developed by the community. The core components of the framework include MET, the associated database and display systems called METviewer and METexpress, and a suite of Python wrappers to provide low-level automation and examples, also called use-cases. A description of each tool along with some ancillary repositories are as follows:

  • MET - core statistical tool that matches up grids with either gridded analyses or point observations and applies configurable methods to compute statistics and diagnostics
  • METviewer - core database and display system intended for deep analysis of MET output
  • METexpress - core database and display system intended for quick analysis via pre-defined queries of MET output
  • METplus wrappers - suite of Python-based wrappers that provide low-level automation of MET tools and newly developed plotting capability
  • METplus use-cases - configuration files and sample data to show how to invoke METplus wrappers to make using MET tools easier and reproducible
  • METcalcpy - suite of Python-based scripts to be used by other components of METplus tools for statistical aggregation, event equalization, and other analysis needs
  • METplotpy - suite of Python-based scripts to plot MET output, and in come cases provide additional post-processing of output prior to plotting
  • METdatadb - database to store MET output and to be used by both METviewer and METexpress

The umbrella repository will be brought together by using a software package called manage_externals developed by the Community Earth System Modeling (CESM) team, hosted at NCAR and NOAA Earth System's Research Laboratory. The manage_externals paackage was developed because CESM is comprised of a number of different components that are developed and managed independently. Each component also may have additional "external" dependencies that need to be maintained independently.

Acronyms

  • MET - Model Evaluation Tools
  • DTC - Developmental Testbed Center
  • NCAR - National Center for Atmospheric Research
  • NOAA - National Oceanic and Atmospheric Administration
  • EMC - Environmental Modeling Center
  • VSDB - Verification Statistics Data Base
  • MODE - Method for Object-Based Diagnostic Evaluation
  • UFS - Unified Forecast System
  • SIMA -System for Integrated Modeling of the Atmosphere
  • ESRL - Earth Systems Research Laboratory
  • HIWPP - High Impact Weather Predication Project
  • NGGPS - Next Generation Global Predicatio System
  • GSD - Global Systems Division

Authors

Many authors, listed below in alphabetical order, have contributed to the documentation of MET. To cite this documentation in publications, please refer to the MET User's Guide Citation Instructions<citations>.

  • David Ahijevych1
  • Lindsay Blank
  • Barbara Brown2
  • Randy Bullock3
  • Tatiana Burek4
  • David Fillmore5
  • Tressa Fowler
  • Eric Gilleland6
  • Lisa Goodrich7
  • John Halley Gotway8
  • Tracy Hertneky9
  • Lacey Holland
  • Anne Holmes
  • Michelle Harrold10
  • Tara Jensen11
  • George McCabe12
  • Kathryn Newman13
  • Paul Oldenburg
  • John Opatz14
  • Julie Prestopnik15
  • Paul Prestopnik16
  • Nancy Rehak
  • Howard Soh17
  • Bonny Strong18
  • Minna Win-Gildenmeister19

Organization

Users_Guide/index Contributors_Guide/index

Index

  • genindex

  1. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  2. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  3. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  4. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  5. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  6. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  7. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  8. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  9. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  10. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  11. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  12. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  13. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  14. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  15. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  16. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  17. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩

  18. Cooperative Institute for Research in the Atmosphere at National Oceanic and Atmospheric Administration (NOAA) Earth System Research Laboratory↩

  19. National Center for Atmospheric Research, Research Applications Laboratory, Developmental Testbed Center↩