Skip to content

LISF Public 7.8.0 Release

Latest

Choose a tag to compare

@jvgeiger jvgeiger released this 09 Jun 13:26

General Release notes:

  • Update LIS Public Testcase Walkthrough

LDT Release notes:

  • Add Snow and Ice Products (SNIP) subsystem
  • Add Weather Satellite Follow-on Microwave (WSF-M) runmode
  • Support Weather Satellite Follow-on Microwave (WSF-M) soil moisture retrievals and CDF generation
  • Support processing US Navy ESPC-D data in USAFSI
  • Support processing AquaCrop parameters
  • Support processing HYMAP levee, node lat, node lon, runoff bias, urban drain outlet, and land grid area parameters
  • Support ensemble mode for RAPID
  • Support operational enhanced SMAP (SMAP_E_OPL) soil moisture retrievals
  • Fix reporting check for prior 12z analysis in USAFSI
  • Fix slope values along coastal areas for MERIT 1K
  • Fix unnecessary memory allocation and logs in MERRA-2 metforcing
  • Implement additional sampling strategy for ensemble restart generation to address speckling issues in medium range forecasts
  • Rewrite HDF5 subset reader for L1B files
  • Fix errors raised by Cray compilers
  • Fix errors raised by GNU compilers
  • Address warnings raised by Intel compilers
  • Set default NetCDF deflate level to 1

LIS Release notes:

  • Add HyMAP3 router
  • Add AquaCrop v7.2 crop model
  • Add SnowModel version April-2021 —  for newer versions, contact Glen Liston: glen.liston@colostate.edu
  • Support processing Snow and Ice Products (SNIP) analysis
  • Support data assimilation of SWOT water level observations
  • Support data assimilation of Weather Satellite Follow-on Microwave (WSF-M) soil moisture
  • Support processing Met Office Global and Regional Ensemble Prediction System - global ensemble (MOGREPS-G) forecasts
  • Add forecast runmode for NoahMP401 and Openwater
  • Add GALWEM radiation reader
  • Add support for IMERG V8 in AGRMET metforcing
  • Add ParFlow coupling for Noah and NoahMP
  • Add NoahMP groundwater coupling through NUOPC Cap
  • Support PotEvap_tavg from NoahMP401
  • Support RAPID ensemble mode
  • Update Bratseth tuning software
  • Add inverse exponential correlation function option
  • Add runoff bias correction capability, and remove evapotranspiration from LIS output reader
  • Change to support WIGOS in autotuning
  • Correct writing 1-D lat/lon values into output file
  • Correct writing 1-D lat/lon values into routing output file
  • Fix to avoid repeat precip analysis 15 min after start
  • Increase number of screen-level observations used in analysis
  • Update bookends for surface pressure in AGRMET code
  • Update IMERG version to V07C
  • Fix slope values along coastal areas for MERIT 1K
  • Fix errors raised by Cray compilers
  • Fix errors raised by GNU compilers
  • Address warnings raised by Intel compilers
  • Set default NetCDF deflate level to 1
  • Update S2S
    • Address issue that 7.7.1 occasionally failed to load s2spost processed daily files for temporal aggregation on HPC-11.
    • Resolve all "Future Warnings" messages.
    • Update the NMME file checker to detect slices that are empty, undefined, or consists entirely of unrealistic values.
    • Add HydroSCS as an observational dataset.
    • Introduce an option to apply lapse rate and aspect ratio corrections to meteorological forecasts.
    • Split the bcsd processing into seven modular internal functions: _mf_regridding, _mf_biascorr, _mf_temporal_disaggr, _pr_regridding, _pr_biascorr, _pr_temporal_disaggr, and _combine_forcings.
    • Relocate the S2Srun Class to main/experiment_setup.py, move s2s_app/walltime.py, hcast_module.py (from s2s_app/s2s_hcast.py) and s2s_app/s2s_api.py to main/.
    • Introduce a new module s2s_app/s2s_hydrosfs.py.
    • Add the capability to significantly reduce file sizes by packing data using variable-specific scale_factor and add_offset attributes.
    • Reduce LISDA and FCST wall-clock times by implementing domain decomposition across 23 hydrologic basins, followed by a final grid-stitching process.
    • Set proper HPC-11 modules in test_ghis2s.sh
    • Fix HPC-11 modulepath in shared/utils.py and main/experiment.py.
    • Increase robustness of load_ncdata by adding a loop to ensure all files are ready to be loaded with checks.
    • Increase walltime in s2smetric to 2h.
    • GHI-S2S software is now presented as "ghis2s" Python package
    • New master script: s2s_run.py Python script replaced the s2s_run.sh bash script
    • s2s_preprocess_hcast.sh was replaced with a Python script -- s2s_hcast.py that uses the S2Srun Class in s2s_run.py
    • Added a python module walltimes.py to compute walltimes of individual jobs for both SLURM and Cylc workflow management systems
    • Parallelized bcsd, s2spost, s2smetrics and s2splots scripts reducing walltime by approximately 80%
    • Reorganized, refactored and in some cases rewrote bcsd, s2spost and s2smterics scripts
    • Removed few redundant parameters from the main config file
    • Removed symbolic links as much as possible, and reorganize the intermediate steps in BCSD
    • Removed excessive writing of intermediate files in S2SMETRICS entirely
    • Forcings variable names were made consistent across BCSD steps
    • Integrated Cylc workflow management software in compliant with the 16WS's GHI-repos software
    • Provides a coupler (ghis2s_program.py) for 16WS's GHI-repos and associated shell script for stand alone execution of ghis2s_program.py
    • Implemented a centralized logging system - an unified logging system that generates auto-updating master log files during forecast operations
    • Updated BCSD scripts to process finer resolution global grids (10km and 5km) while maintaining operational constraints of 6-hour walltime and 250GB memory limits.
    • added GEOSv3 forecast reader to BCSD in addition to CFSv2
    • Sub-X: added weekly files and metrics
    • Fault tolerance enhancements : more input file checkers and touched FAILED job files for job failures

LVT Release notes:

  • Add SNIPpost runmode
  • Support processing SMAP L2 NRT soil moisture retrieval product
  • Support processing PotEvap_tavg from NoahMP401
  • Fix IMERG reader to support any order of data comparison
  • Fix floating invalid error when computing daily statistics with missing hourly data
  • Fix errors raised by Cray compilers
  • Fix errors raised by GNU compilers
  • Address warnings raised by Intel compilers
  • Set default NetCDF deflate level to 1

AppImage

This AppImage is compatible with:

  • Linux: x86_64 machines (as reported by uname -s -m)
  • GLIBC: 2.22 or newer (as reported by ldd --version)
  • MPI: MPICH, Intel MPI, or Cray MPI

After downloading the AppImage, run:

chmod 755 ./LISF-x86_64.AppImage

To get started with the AppImage, run:

./LISF-x86_64.AppImage -h

Note:

This AppImage requires FUSE to run. If you get an error, then try:

mkdir LISF-x86_64
cd LISF-x86_64
../LISF-x86_64.AppImage --appimage-extract
cd ..
./LISF-x86_64/squashfs-root/AppRun -h