From cfe37eab9b1d453d1790372fadb7dea36b24f0e7 Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Mon, 3 May 2021 15:01:55 -0600 Subject: [PATCH 1/9] Per #1731, add ioda2nc documentation. --- met/docs/Users_Guide/data_io.rst | 30 +++-- met/docs/Users_Guide/overview.rst | 2 +- met/docs/Users_Guide/reformat_point.rst | 145 +++++++++++++++++++++++- 3 files changed, 160 insertions(+), 17 deletions(-) diff --git a/met/docs/Users_Guide/data_io.rst b/met/docs/Users_Guide/data_io.rst index 2a97f546c5..3dd4552ab9 100644 --- a/met/docs/Users_Guide/data_io.rst +++ b/met/docs/Users_Guide/data_io.rst @@ -10,13 +10,13 @@ Data must often be preprocessed prior to using it for verification. Several MET Input data formats __________________ -The MET package can handle gridded input data in one of four formats: GRIB version 1, GRIB version 2, NetCDF files following the Climate and Forecast (CF) conventions, and NetCDF files produced by the MET tools themselves. MET supports standard NCEP, USAF, UKMet Office and ECMWF grib tables along with custom, user-defined GRIB tables and the extended PDS including ensemble member metadata. See :numref:`Configuration File Details` for more information. Point observation files may be supplied in either PrepBUFR, ASCII, or MADIS format. Note that MET does not require the Unified Post-Processor to be used, but does require that the input GRIB data be on a standard, de-staggered grid on pressure or regular levels in the vertical. While the Grid-Stat, Wavelet-Stat, MODE, and MTD tools can be run on a gridded field at virtually any level, the Point-Stat tool can only be used to verify forecasts at the surface or on pressure or height levels. MET does not interpolate between native model vertical levels. +The MET package can handle multiple gridded input data formats: GRIB version 1, GRIB version 2, and NetCDF files following the Climate and Forecast (CF) conventions, containing WRF output post-processed using wrf_interp, or produced by the MET tools themselves. MET supports standard NCEP, USAF, UKMet Office and ECMWF GRIB tables along with custom, user-defined GRIB tables and the extended PDS including ensemble member metadata. See :numref:`Configuration File Details` for more information. Point observation files may be supplied in either PrepBUFR, ASCII, or MADIS format. Note that MET does not require the Unified Post-Processor to be used, but does require that the input GRIB data be on a standard, de-staggered grid on pressure or regular levels in the vertical. While the Grid-Stat, Wavelet-Stat, MODE, and MTD tools can be run on a gridded field at virtually any level, the Point-Stat tool can only be used to verify forecasts at the surface or on pressure or height levels. MET does not interpolate between native model vertical levels. When comparing two gridded fields with the Grid-Stat, Wavelet-Stat, Ensemble-Stat, MODE, MTD, or Series-Analysis tools, the input model and observation datasets must be on the same grid. MET will regrid files according to user specified options. Alternatively, outside of MET, the copygb and wgrib2 utilities are recommended for re-gridding GRIB1 and GRIB2 files, respectively. To preserve characteristics of the observations, it is generally preferred to re-grid the model data to the observation grid, rather than vice versa. -Input point observation files in PrepBUFR format are available through NCEP. The PrepBUFR observation files contain a wide variety of point-based observation types in a single file in a standard format. However, some users may wish to use observations not included in the standard PrepBUFR files. For this reason, prior to performing the verification step in the Point-Stat tool, the PrepBUFR file is reformatted with the PB2NC tool. In this step, the user can select various ways of stratifying the observation data spatially, temporally, and by type. The remaining observations are reformatted into an intermediate NetCDF file. The ASCII2NC tool may be used to convert ASCII point observations that are not available in the PrepBUFR files into this NetCDF format for use by the Point-Stat verification tool. Users with METAR or RAOB data from MADIS can convert these observations into NetCDF format with the MADIS2NC tool, then use them with the Point-Stat or Ensemble-Stat verification tools. +Input point observation files in PrepBUFR format are available through NCEP. The PrepBUFR observation files contain a wide variety of point-based observation types in a single file in a standard format. However, some users may wish to use observations not included in the standard PrepBUFR files. For this reason, prior to performing the verification step in the Point-Stat tool, the PrepBUFR file is reformatted with the PB2NC tool. In this step, the user can select various ways of stratifying the observation data spatially, temporally, and by type. The remaining observations are reformatted into an intermediate NetCDF file. The ASCII2NC tool may be used to convert ASCII point observations that are not available in the PrepBUFR files into this common NetCDF point observation format. Several other MET tools, described below, are also provided to reformat point observations into this common NetCDF point observation format prior to passing them as input to the Point-Stat or Ensemble-Stat verification tools. -Tropical cyclone forecasts and observations are typically provided in a specific ASCII format, in A Deck and B Deck files. +Tropical cyclone forecasts and observations are typically provided in a specific ATCF (Automated Tropical Cyclone Forecasting) ASCII format, in A-deck, B-deck, and E-deck files. .. _Intermediate data formats: @@ -55,32 +55,38 @@ The following is a summary of the input and output formats for each of the tools #. **PB2NC Tool** - * **Input**: One PrepBUFR point observation file and one configuration file. + * **Input**: PrepBUFR point observation file(s) and one configuration file. * **Output**: One NetCDF file containing the observations that have been retained. #. **ASCII2NC Tool** - * **Input**: One or more ASCII point observation file(s) that has (have) been formatted as expected, and optional configuration file. + * **Input**: ASCII point observation file(s) that has (have) been formatted as expected, and optional configuration file. * **Output**: One NetCDF file containing the reformatted observations. #. **MADIS2NC Tool** - * **Input**: One MADIS point observation file. + * **Input**: MADIS point observation file(s) in NetCDF format. * **Output**: One NetCDF file containing the reformatted observations. #. **LIDAR2NC Tool** - * **Input**: One CALIPSO satellite HDF file + * **Input**: One CALIPSO satellite HDF file. + + * **Output**: One NetCDF file containing the reformatted observations. + +#. **IODA2NC Tool** + + * **Input**: IODA observation file(s) in NetCDF format. * **Output**: One NetCDF file containing the reformatted observations. #. **Point2Grid Tool** - * **Input**: One NetCDF file containing point observation from the ASCII2NC, PB2NC, MADIS2NC, or LIDAR2NC tool. + * **Input**: One NetCDF file in the common point observation format. * **Output**: One NetCDF file containing a gridded representation of the point observations. @@ -116,7 +122,7 @@ The following is a summary of the input and output formats for each of the tools #. **Point-Stat Tool** - * **Input**: One gridded model file, at least one point observation file in NetCDF format (as the output of the PB2NC, ASCII2NC, MADIS2NC, or LIDAR2NC tool), and one configuration file. + * **Input**: One gridded model file, at least one NetCDF file in the common point observation format, and one configuration file. * **Output**: One STAT file containing all of the requested line types and several ASCII files for each line type requested. @@ -194,9 +200,9 @@ The following is a summary of the input and output formats for each of the tools #. **TC-Pairs Tool** - * **Input**: At least one A-deck and one B-deck ATCF format file containing output from a tropical cyclone tracker and one configuration file. The A-deck files contain forecast tracks while the B-deck files are typically the NHC Best Track Analysis but could also be any ATCF format reference. + * **Input**: At least one A-deck or E-deck file and one B-deck ATCF format file containing output from a tropical cyclone tracker and one configuration file. The A-deck files contain forecast tracks, the E-deck files contain forecast probabilities, and the B-deck files are typically the NHC Best Track Analysis but could also be any ATCF format reference. - * **Output**: ASCII output with the suffix .tcstat. + * **Output**: ASCII output with the suffix .tcst. #. **TC-Stat Tool** @@ -208,7 +214,7 @@ The following is a summary of the input and output formats for each of the tools * **Input**: One or more Tropical Cyclone genesis format files, one or more verifying operational and BEST track files in ATCF format, and one configuration file. - * **Output**: One STAT file containing all of the requested line types and several ASCII files for each line type requested. + * **Output**: One STAT file containing all of the requested line types, several ASCII files for each line type requested, and one gridded NetCDF file containing counts of track points. #. **TC-RMW Tool** diff --git a/met/docs/Users_Guide/overview.rst b/met/docs/Users_Guide/overview.rst index 9450a2e3af..733255d409 100644 --- a/met/docs/Users_Guide/overview.rst +++ b/met/docs/Users_Guide/overview.rst @@ -57,7 +57,7 @@ The MODE (Method for Object-based Diagnostic Evaluation) tool also uses gridded The MODE-TD tool extends object-based analysis from two-dimensional forecasts and observations to include the time dimension. In addition to the two dimensional information provided by MODE, MODE-TD can be used to examine even more features including displacement in time, and duration and speed of moving areas of interest. -The Grid-Diag tools produce multivariate probability density functions (PDFs) that may be used either for exploring the relationship between two fields, or for the computation of percentiles generated from the sample for use with percentile thresholding. The output from this tool requires post-processing by METplus or user-provided utilities. +The Grid-Diag tool produces multivariate probability density functions (PDFs) that may be used either for exploring the relationship between two fields, or for the computation of percentiles generated from the sample for use with percentile thresholding. The output from this tool requires post-processing by METplus or user-provided utilities. The Wavelet-Stat tool decomposes two-dimensional forecasts and observations according to the Intensity-Scale verification technique described by :ref:`Casati et al. (2004) `. There are many types of spatial verification approaches and the Intensity-Scale technique belongs to the scale-decomposition (or scale-separation) verification approaches. The spatial scale components are obtained by applying a wavelet transformation to the forecast and observation fields. The resulting scale-decomposition measures error, bias and skill of the forecast on each spatial scale. Information is provided on the scale dependency of the error and skill, on the no-skill to skill transition scale, and on the ability of the forecast to reproduce the observed scale structure. The Wavelet-Stat tool is primarily used for precipitation fields. However, the tool can be applied to other variables, such as cloud fraction. diff --git a/met/docs/Users_Guide/reformat_point.rst b/met/docs/Users_Guide/reformat_point.rst index 2dfdce4b1c..17a73fec15 100644 --- a/met/docs/Users_Guide/reformat_point.rst +++ b/met/docs/Users_Guide/reformat_point.rst @@ -599,13 +599,13 @@ MADIS2NC tool _____________ -This section describes how to run the MADIS2NC tool. The MADIS2NC tool is used to reformat `Meteorological Assimilation Data Ingest System (MADIS) `_ point observations into the NetCDF format expected by the MET statistics tools. Since the MADIS2NC tool simply performs a reformatting step, no configuration file is needed. The MADIS2NC tool supports many of the MADIS data types, as listed in the usage statement below. Support for additional MADIS data types may be added in the future based on user feedback. +This section describes how to run the MADIS2NC tool. The MADIS2NC tool is used to reformat `Meteorological Assimilation Data Ingest System (MADIS) `_ point observations into the NetCDF format expected by the MET statistics tools. An optional configuration file controls the processing of the point observations. The MADIS2NC tool supports many of the MADIS data types, as listed in the usage statement below. Support for additional MADIS data types may be added in the future based on user feedback. madis2nc usage ~~~~~~~~~~~~~~ -The usage statement for MADIS2NC tool is shown below: +The usage statement for the MADIS2NC tool is shown below: .. code-block:: none @@ -635,7 +635,7 @@ Required arguments for madis2nc 1. The **madis_file** argument is one or more input MADIS point observation files to be processed. -2. The **netcdf_file** argument is the NetCDF output file to be written. +2. The **out_file** argument is the NetCDF output file to be written. 3. The argument **-type str** is a type of MADIS observations (metar, raob, profiler, maritime, mesonet or acarsProfiles). @@ -778,7 +778,6 @@ We will not give a detailed description of each CALIPSO data product that lidar2 **Layer_Base** gives the elevation in meters above ground level of the cloud base for each cloud level at each observation location. Similarly, **Layer_Top** gives the elevation of the top of each cloud layer. Note that if there are multiple cloud layers at a particular location, then there will be more than one base (or top) given for that location. For convenience, **Min_Base** and **Max_Top** give, respectively, the base elevation for the bottom cloud layer, and the top elevation for the top cloud layer. For these data types, there will be only one value per observation location regardless of how many cloud layers there are at that location. - .. _lidar2nc_grib_code_table: .. list-table:: lidar2nc GRIB codes and their meaning, units, and abbreviations @@ -837,7 +836,145 @@ We will not give a detailed description of each CALIPSO data product that lidar2 - Horizontal Averaging - NA - Horizontal_Averaging + + +IODA2NC tool +____________ + + +This section describes the IODA2NC tool which is used to reformat IODA (Interface for Observation Data Access) point observations from the `Joint Center for Satellite Data Assimilation (JCSDA) `_ into the NetCDF format expected by the MET statistics tools. An optional configuration file controls the processing of the point observations. The IODA2NC tool reads NetCDF point observation files created by the `IODA Converters `_. Support for interfacing with data from IODA may be added in the future based on user feedback. + + +ioda2nc usage +~~~~~~~~~~~~~ + +The usage statement for the IODA2NC tool is shown below: + +.. code-block:: none + + Usage: ioda2nc + ioda_file + netcdf_file + [-config config_file] + [-obs_var var] + [-iodafile ioda_file] + [-valid_beg time] + [-valid_end time] + [-nmsg n] + [-log file] + [-v level] + [-compress level] + +ioda2nc has required arguments and can also take optional ones. + +Required arguments for ioda2nc +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +1. The **ioda_file** argument is an input IODA NetCDF point observation file to be processed. + +2. The **netcdf_file** argument is the NetCDF output file to be written. + +Optional arguments for ioda2nc +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +3. The **-config config_file** is a IODA2NCConfig file to filter the point observations and define time summaries. + +4. The **-obs_var var_list** setting is a comma-separated list of variables to be saved from input the input file (by defaults, saves "all"). + +5. The **-iodafile ioda_file** option specifies additional input IODA observation files to be processed. + +6. The **-valid_beg time** and **-valid_end time** options in YYYYMMDD[_HH[MMSS]] format overrides the retention time window from the configuration file. + +7. The **-nmsg n** indicates the number of IODA records to process. + +8. The **-log** file option directs output and errors to the specified log file. All messages will be written to that file as well as standard out and error. Thus, users can save the messages without having to redirect the output on the command line. The default behavior is no log file. + +9. The **-v level** option indicates the desired level of verbosity. The value of “level” will override the default setting of 2. Setting the verbosity to 0 will make the tool run with no log messages, while increasing the verbosity above 1 will increase the amount of logging. + +10. The **-compress level** option indicates the desired level of compression (deflate level) for NetCDF variables. The valid level is between 0 and 9. The value of “level” will override the default setting of 0 from the configuration file or the environment variable MET_NC_COMPRESS. Setting the compression level to 0 will make no compression for the NetCDF output. Lower number is for fast compression and higher number is for better compression. + +An example of the ioda2nc calling sequence is shown below: + +.. code-block:: none + + ioda2nc \ + ioda.NC001007.2020031012.nc ioda2nc.2020031012.nc \ + -config IODA2NCConfig -v 3 -lg run_ioda2nc.log +In this example, the IODA2NC tool will reformat the data in the input ioda.NC001007.2020031012.nc file and write the output to a file named ioda2nc.2020031012.nc. The data to be processed is specified by IODA2NCConfig, log messages will be written to the ioda2nc.log file, and the verbosity level is three. + + +ioda2nc configuration file +~~~~~~~~~~~~~~~~~~~~~~~~~~ + +The default configuration file for the IODA2NC tool named **IODA2NcConfig_default** can be found in the installed *share/met/config* directory. It is recommended that users make a copy of this file prior to modifying its contents. + +The IODA2NC configuration file is optional and only necessary when defining filtering the input observations or defining time summaries. The contents of the default IODA2NC configuration file are described below. + +__________________ + +.. code-block:: none + + obs_window = { beg = -5400; end = 5400; } + mask = { grid = ""; poly = ""; } + tmp_dir = "/tmp"; + version = "VN.N"; + +The configuration options listed above are common to many MET tools and are described in :numref:`config_options`. + +_________________ + + +.. code-block:: none + + message_type = []; + message_type_group_map = []; + message_type_map = []; + station_id = []; + elevation_range = { ... }; + level_range = { ... }; + obs_var = []; + quality_mark_thresh = 0; + time_summary = { ... } + +The configuration options listed above are supported by other point observation pre-processing tools and are described in :numref:`pb2nc configuration file`. + +_________________ + +.. code-block:: none + + obs_name_map = []; + +This entry is an array of dictionaries, each containing a **key** string and **val** string which define a mapping of input IODA variable names to output variable names. The default IODA map, obs_var_map, is appended to this map. + +_________________ + +.. code-block:: none + + metadata_map = [ + { key = "message_type"; val = "msg_type"; }, + { key = "station_id"; val = "report_identifier"; }, + { key = "pressure"; val = "air_pressure,pressure"; }, + { key = "height"; val = "height,height_above_mean_sea_level"; }, + { key = "elevation"; val = ""; } + ]; + +This entry is an array of dictionaries, each containing a **key** string and **val** string which define a mapping of metadata for IODA data files. + +_________________ + +.. code-block:: none + + missing_thresh = [ <=-1e9, >=1e9, ==-9999 ]; + +The **missing_thresh** option is an array of thresholds. Any data values which meet any of these thresholds are interpreted as being bad, or missing, data. + + +ioda2nc output +~~~~~~~~~~~~~~ + +The NetCDF output of the IODA2NC tool is structured in the same way as the output of the PB2NC tool described in :numref:`pb2nc output`. + Point2Grid tool _______________ From 5201e14ec352ba55dd44689efd4ca89a2c9832fb Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Tue, 4 May 2021 16:11:31 -0600 Subject: [PATCH 2/9] Changes to make the authorship list consistent with METplus. --- met/docs/Users_Guide/index.rst | 7 +++-- met/docs/conf.py | 16 +++++------- met/docs/index.rst | 47 ++++++++++++++++++++++++++++++---- 3 files changed, 51 insertions(+), 19 deletions(-) diff --git a/met/docs/Users_Guide/index.rst b/met/docs/Users_Guide/index.rst index e687d3ac5e..40151728e5 100644 --- a/met/docs/Users_Guide/index.rst +++ b/met/docs/Users_Guide/index.rst @@ -8,8 +8,6 @@ This User's guide is provided as an aid to users of the Model Evaluation Tools ( It is important to note here that MET is an evolving software package. This documentation describes the |release| release dated |release_date|. Previous releases of MET have occurred each year since 2008. Intermediate releases may include bug fixes. MET is also able to accept new modules contributed by the community. If you have code you would like to contribute, we will gladly consider your contribution. Please send an email to: `met_help@ucar.edu `__. We will then determine the maturity of the new verification method and coordinate the inclusion of the new module in a future version. -This User's Guide was prepared by many current and former developers of MET, including David Ahijevych, Lindsay Blank, Barbara Brown, Randy Bullock, Tatiana Burek, David Fillmore, Tressa Fowler, Eric Gilleland, Lisa Goodrich, John Halley Gotway, Tracy Hertneky, Lacey Holland, Anne Holmes, Michelle Harrold, Tara Jensen, George McCabe, Kathryn Newman, Paul Oldenburg, John Opatz, Julie Prestopnik, Paul Prestopnik, Nancy Rehak, Howard Soh, Bonny Strong, and Minna Win-Gildenmeister. - **Model Evaluation Tools (MET) TERMS OF USE - IMPORTANT!** Copyright |copyright| @@ -26,13 +24,14 @@ the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. +.. _citations: + **Citations** The citation for this User's Guide should be: |author_list|, |release_year|: The MET Version |version| User's Guide. -Developmental Testbed Center. -Available at: `MET releases `_ +Developmental Testbed Center. Available at: https://github.com/dtcenter/MET/releases **Acknowledgments** diff --git a/met/docs/conf.py b/met/docs/conf.py index 5d54deb22a..eff4dbae1f 100644 --- a/met/docs/conf.py +++ b/met/docs/conf.py @@ -75,13 +75,9 @@ # -- Export variables -------------------------------------------------------- -rst_epilog = """ -.. |copyright| replace:: {copyrightstr} -.. |author_list| replace:: {author_liststr} -.. |release_date| replace:: {release_datestr} -.. |release_year| replace:: {release_yearstr} -""".format(copyrightstr = copyright, - author_liststr = author_list, - release_datestr = release_date, - release_yearstr = release_year) - +rst_epilog = f""" +.. |copyright| replace:: {copyright} +.. |author_list| replace:: {author_list} +.. |release_date| replace:: {release_date} +.. |release_year| replace:: {release_year} +""" diff --git a/met/docs/index.rst b/met/docs/index.rst index a66a482aa1..2897901d29 100644 --- a/met/docs/index.rst +++ b/met/docs/index.rst @@ -90,7 +90,48 @@ Acronyms * **HIWPP** - High Impact Weather Predication Project * **NGGPS** - Next Generation Global Predicatio System * **GSD** - Global Systems Division - + +Authors +------- + +Many authors, listed below in alphabetical order, have contributed to the documentation of MET. +To cite this documentation in publications, please refer to the MET User's Guide :ref:`Citation Instructions`. + +* David Ahijevych [#NCAR]_ +* Lindsay Blank +* Barbara Brown [#NCAR]_ +* Randy Bullock [#NCAR]_ +* Tatiana Burek [#NCAR]_ +* David Fillmore [#NCAR]_ +* Tressa Fowler +* Eric Gilleland [#NCAR]_ +* Lisa Goodrich [#NCAR]_ +* John Halley Gotway [#NCAR]_ +* Tracy Hertneky [#NCAR]_ +* Lacey Holland +* Anne Holmes +* Michelle Harrold [#NCAR]_ +* Tara Jensen [#NCAR]_ +* George McCabe [#NCAR]_ +* Kathryn Newman [#NCAR]_ +* Paul Oldenburg +* John Opatz [#NCAR]_ +* Julie Prestopnik [#NCAR]_ +* Paul Prestopnik [#NCAR]_ +* Nancy Rehak [#NCAR]_ +* Howard Soh [#NCAR]_ +* Bonny Strong [#CIR]_ +* Minna Win-Gildenmeister [#NCAR]_ + +.. rubric:: Organization + +.. [#NCAR] `National Center for Atmospheric Research, Research + Applications Laboratory `_, `Developmental Testbed Center `_ +.. [#CIR] `Cooperative Institute for Research in the Atmosphere at + National Oceanic and Atmospheric Administration (NOAA) Earth + System Research Laboratory `_ + + .. toctree:: :hidden: :caption: Model Evaluation Tools @@ -102,7 +143,3 @@ Index ===== * :ref:`genindex` - - - - From d6618d6b3b9a005d0aa62fad28eb27ff9951e3c1 Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Tue, 4 May 2021 16:38:45 -0600 Subject: [PATCH 3/9] Rename CIR to CIRA. --- met/docs/index.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/met/docs/index.rst b/met/docs/index.rst index 2897901d29..dc494fd188 100644 --- a/met/docs/index.rst +++ b/met/docs/index.rst @@ -118,16 +118,16 @@ To cite this documentation in publications, please refer to the MET User's Guide * John Opatz [#NCAR]_ * Julie Prestopnik [#NCAR]_ * Paul Prestopnik [#NCAR]_ -* Nancy Rehak [#NCAR]_ +* Nancy Rehak * Howard Soh [#NCAR]_ -* Bonny Strong [#CIR]_ +* Bonny Strong [#CIRA]_ * Minna Win-Gildenmeister [#NCAR]_ .. rubric:: Organization .. [#NCAR] `National Center for Atmospheric Research, Research Applications Laboratory `_, `Developmental Testbed Center `_ -.. [#CIR] `Cooperative Institute for Research in the Atmosphere at +.. [#CIRA] `Cooperative Institute for Research in the Atmosphere at National Oceanic and Atmospheric Administration (NOAA) Earth System Research Laboratory `_ From bb9f18ebca6cfb7d32583471a43006bc673de985 Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Wed, 5 May 2021 10:43:41 -0600 Subject: [PATCH 4/9] Per #1731, fix alignment issued caused by tabs vs spaces. --- met/docs/Users_Guide/reformat_point.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/met/docs/Users_Guide/reformat_point.rst b/met/docs/Users_Guide/reformat_point.rst index 17a73fec15..f872a12b40 100644 --- a/met/docs/Users_Guide/reformat_point.rst +++ b/met/docs/Users_Guide/reformat_point.rst @@ -931,9 +931,9 @@ _________________ message_type_group_map = []; message_type_map = []; station_id = []; - elevation_range = { ... }; - level_range = { ... }; - obs_var = []; + elevation_range = { ... }; + level_range = { ... }; + obs_var = []; quality_mark_thresh = 0; time_summary = { ... } From 4427233cee9808a8ecf83795e1b82f378086a296 Mon Sep 17 00:00:00 2001 From: j-opatz <59586397+j-opatz@users.noreply.github.com> Date: Fri, 7 May 2021 11:06:58 -0600 Subject: [PATCH 5/9] Updated input sources to include newly acceptable data formats --- met/docs/Users_Guide/tc-pairs.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/met/docs/Users_Guide/tc-pairs.rst b/met/docs/Users_Guide/tc-pairs.rst index 2df76d0506..57bffcf04e 100644 --- a/met/docs/Users_Guide/tc-pairs.rst +++ b/met/docs/Users_Guide/tc-pairs.rst @@ -35,11 +35,11 @@ tc_pairs has required arguments and can accept several optional arguments. Required arguments for tc_pairs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ -1. The **-adeck source** argument indicates the adeck ATCF format data source containing tropical cyclone model forecast (output from tracker) data to be verified. It specifies the name of an ATCF format file or top-level directory containing ATCF format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. +1. The **-adeck source** argument indicates the adeck TC-Pairs acceptable format data source containing tropical cyclone model forecast (output from tracker) data to be verified. Acceptable data formats are limited to the standard ATCF format and the one column modified ATCF file, generated from a genesis mode run for extratropical cyclones. It specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. 2. The **-edeck source** argument indicates the edeck ATCF format data source containing probabilistic track data to be verified. It specifies the name of an ATCF format file or top-level directory containing ATCF format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. -3. The **-bdeck source** argument indicates the ATCF format data source containing the tropical cyclone reference dataset to be used for verifying the adeck source. It specifies the name of an ATCF format file or top-level directory containing ATCF format files ending in “.dat” to be processed. This source is expected to be the NHC Best Track Analysis, but could also be any ATCF-formatted reference. +3. The **-bdeck source** argument indicates the TC-Pairs acceptable format data source containing the tropical cyclone reference dataset to be used for verifying the adeck source. This source is typically the NHC Best Track Analysis, but could be any TC-Pairs acceptable formatted reference. The acceptable data formats for bdecks are the same as those for adecks. This arguement specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. 4. The **-config file** argument indicates the name of the configuration file to be used. The contents of the configuration file are discussed below. From 278e57bac90f2e937f73af62286da4aee66c9c04 Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Fri, 7 May 2021 11:07:48 -0600 Subject: [PATCH 6/9] Per #1731, add more details about the grid-diag bin definition. --- met/docs/Users_Guide/grid-diag.rst | 2 ++ 1 file changed, 2 insertions(+) diff --git a/met/docs/Users_Guide/grid-diag.rst b/met/docs/Users_Guide/grid-diag.rst index b84f2acab2..fe0753e084 100644 --- a/met/docs/Users_Guide/grid-diag.rst +++ b/met/docs/Users_Guide/grid-diag.rst @@ -93,6 +93,8 @@ _____________________ The **name** and **level** entries in the **data** dictionary define the data to be processed. The **n_bins** parameter specifies the number of histogram bins for that variable, and the **range** parameter the lower and upper bounds of the histogram. The interval length is the upper and lower difference divided by **n_bins**. +Each bin is inclusive on the left side and exclusive on the right, such as [a,b). Grid-Diag prints a warning message if the actual range of data values falls outside the range defined for that variable in the configuration file. Any data values less than or greater than the configured range are counted in the first or last bin, respectively. + grid_diag output file ~~~~~~~~~~~~~~~~~~~~~ From a8d2a99f12a40c90b9dd8f629ea235562b907438 Mon Sep 17 00:00:00 2001 From: John Halley Gotway Date: Fri, 7 May 2021 11:15:14 -0600 Subject: [PATCH 7/9] Per #1731, clarify wording. --- met/docs/Users_Guide/grid-diag.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/met/docs/Users_Guide/grid-diag.rst b/met/docs/Users_Guide/grid-diag.rst index fe0753e084..fb6c14f58c 100644 --- a/met/docs/Users_Guide/grid-diag.rst +++ b/met/docs/Users_Guide/grid-diag.rst @@ -91,9 +91,9 @@ _____________________ ]; } -The **name** and **level** entries in the **data** dictionary define the data to be processed. The **n_bins** parameter specifies the number of histogram bins for that variable, and the **range** parameter the lower and upper bounds of the histogram. The interval length is the upper and lower difference divided by **n_bins**. +The **name** and **level** entries in the **data** dictionary define the data to be processed. The **n_bins** parameter specifies the number of histogram bins for that variable, and the **range** parameter the lower and upper bounds of the histogram. The interval length is the upper and lower difference divided by **n_bins**. Each bin is inclusive on the left side and exclusive on the right, such as [a,b). -Each bin is inclusive on the left side and exclusive on the right, such as [a,b). Grid-Diag prints a warning message if the actual range of data values falls outside the range defined for that variable in the configuration file. Any data values less than or greater than the configured range are counted in the first or last bin, respectively. +Grid-Diag prints a warning message if the actual range of data values falls outside the range defined for that variable in the configuration file. Any data values less than the configured range are counted in the first bin, while values greater than the configured range are counted in the last bin. grid_diag output file ~~~~~~~~~~~~~~~~~~~~~ From 200897e543261c0f6412b17055b82254e095ed39 Mon Sep 17 00:00:00 2001 From: j-opatz <59586397+j-opatz@users.noreply.github.com> Date: Fri, 7 May 2021 12:41:35 -0600 Subject: [PATCH 8/9] Update met/docs/Users_Guide/tc-pairs.rst Co-authored-by: johnhg --- met/docs/Users_Guide/tc-pairs.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/met/docs/Users_Guide/tc-pairs.rst b/met/docs/Users_Guide/tc-pairs.rst index 57bffcf04e..a0f82295d9 100644 --- a/met/docs/Users_Guide/tc-pairs.rst +++ b/met/docs/Users_Guide/tc-pairs.rst @@ -39,7 +39,7 @@ Required arguments for tc_pairs 2. The **-edeck source** argument indicates the edeck ATCF format data source containing probabilistic track data to be verified. It specifies the name of an ATCF format file or top-level directory containing ATCF format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. -3. The **-bdeck source** argument indicates the TC-Pairs acceptable format data source containing the tropical cyclone reference dataset to be used for verifying the adeck source. This source is typically the NHC Best Track Analysis, but could be any TC-Pairs acceptable formatted reference. The acceptable data formats for bdecks are the same as those for adecks. This arguement specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. +3. The **-bdeck source** argument indicates the TC-Pairs acceptable format data source containing the tropical cyclone reference dataset to be used for verifying the adeck source. This source is typically the NHC Best Track Analysis, but could be any TC-Pairs acceptable formatted reference. The acceptable data formats for bdecks are the same as those for adecks. This argument specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. 4. The **-config file** argument indicates the name of the configuration file to be used. The contents of the configuration file are discussed below. From 82532cbdc377386bebb1b27f2f37822f0a493b9d Mon Sep 17 00:00:00 2001 From: j-opatz <59586397+j-opatz@users.noreply.github.com> Date: Fri, 7 May 2021 13:56:58 -0600 Subject: [PATCH 9/9] Update met/docs/Users_Guide/tc-pairs.rst Co-authored-by: johnhg --- met/docs/Users_Guide/tc-pairs.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/met/docs/Users_Guide/tc-pairs.rst b/met/docs/Users_Guide/tc-pairs.rst index a0f82295d9..24afaf814a 100644 --- a/met/docs/Users_Guide/tc-pairs.rst +++ b/met/docs/Users_Guide/tc-pairs.rst @@ -35,7 +35,7 @@ tc_pairs has required arguments and can accept several optional arguments. Required arguments for tc_pairs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ -1. The **-adeck source** argument indicates the adeck TC-Pairs acceptable format data source containing tropical cyclone model forecast (output from tracker) data to be verified. Acceptable data formats are limited to the standard ATCF format and the one column modified ATCF file, generated from a genesis mode run for extratropical cyclones. It specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. +1. The **-adeck source** argument indicates the adeck TC-Pairs acceptable format data source containing tropical cyclone model forecast (output from tracker) data to be verified. Acceptable data formats are limited to the standard ATCF format and the one column modified ATCF file, generated by running the tracker in genesis mode. It specifies the name of a TC-Pairs acceptable format file or top-level directory containing TC-Pairs acceptable format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once. 2. The **-edeck source** argument indicates the edeck ATCF format data source containing probabilistic track data to be verified. It specifies the name of an ATCF format file or top-level directory containing ATCF format files ending in “.dat” to be processed. The **-adeck** or **-edeck** option must be used at least once.