Skip to content

access_access_ge2_archive_info

Jump to bottom
Paul Leopardi edited this page Feb 13, 2024 · 14 revisions

APS2 ACCESS-GE RDS Archive Information Page

PageOutline

#!div class="important" 
 ####  NOTE: GE2 RDS ARCHIVE DATA OLDER THAN 12 MONTHS WILL BE AGGRESSIVELY TRIMMED (Target date: 12 February 2018)

ACCESS-GE2 archive data location at NCI

  • The top directory for access_ge RDS archive at NCI/raijin is: /g/data3/na3/dev_aps2/access-ge/ (GE_RDS)
    • Note: Users need to apply to be in group "na3" to have read access

Original full archive locations

  • (1) Australis Staging Trial period (GE2G2)

  • GE2 with input from ACCESS-G2 system

  • FULL DATA FROM 1st July 2016 to present

  • Location: $GE_RDS/gef/$YYYY/$MM/$YYYYMMDDHH

  • Full data for the past 12 months to be kept

  • Dates older than 12 months scheduled for deletion

  • (2) Ngamai Development Trial period (GE2G2)

  • GE2 with input from ACCESS-G2 system

  • FULL DATA FROM 10th Sept 2015 to 1st July 2016

  • Location: $GE_RDS/gef_ngamai/$YYYY/$MM/$YYYYMMDDHH

  • Scheduled for deletion

  • (3) Ngamai Development Trial period (GE2G1)

  • GE2 with input from ACCESS-G1 system

  • FULL DATA from 2013122112 -to- 2015120500

  • Location: $GE_RDS/hide/GF/

  • Scheduled for deletion

  • Note overlap between data in (2) and (3) from mid-September to December 2015; for the reduced archive the later gef_ngamai G2-input-based version is the one which will be kept from start of October onwards.

  • Note that the archive dates for the period from 2013122112/ -to- 2014110512/ is incomplete.

    • These dates are in additional subdirectory nc/ within $YYYYMMDDHH/
    • Available dates will be retained in the reduced archive.

ACCESS-GE runs twice daily, 00Z & 12Z. Both times are archived on raijin, where available; for some of the earlier periods only 12Z forecasts were run. The reduced archive will only contain 12Z.

New reduced archive files

  • Original pd.nc single NetCDF file per ensemble member is replaced by 7 files per member

    • 5 pressure level files containing one field each
      • air_temp.nc at 850 hPa
      • geop_ht.nc at 500 hPa
      • relhum.nc at 700 hPa
      • zonal_wnd.nc at 850 hPa, 250 hPa
      • merid_wnd.nc at 850 hPa, 250 hPa
    • 2 single level fields file with 6 fields:
      • single_level_fields.nc: mslp, uwnd10m, vwnd10m, temp_scrn, dewpt_scrn
      • accum_prcp.nc: accum_prcp at 3-hourly intervals
      • Note that uwnd10m/vwnd10m fields undergo name change to u10/v10, from 2016070100 (check) onwards

  • Fields are kept at 6-hourly time intervals rather than 3-hourly as in the full archive (except for accum_prcp).

  • Once-daily archives from the 12UTC daily runs are being retained; 00UTC runs are being removed.

  • Other pressure levels and other single level fields are being removed from the archive.

  • Directory structure of data follows ACCESS-G2 convention

  • $GE_RDS/gef_reduced/YYYYMMDD/HH/cf

  • $GE_RDS/gef_reduced/YYYYMMDD/HH/pf/$ensemble_member_num

  • All files have been converted to netCDF4 and relevant global attributes updated to include metadata identifying which version of GE2 system was run, corresponding to (1), (2), (3) above.

New global attributes for reduced data files

  • Sample global attributes:
  • :Conventions = "CF-1.5,ACDD v1.3" ;
  • :title = "BoM APS2 Global Ensemble Forecast data" ;
  • :summary = "Reduced archive of BoM APS2 global ensemble N216 10-day forecasts. This is a research trial system, not an operational Bureau system." ;
  • :institution = "Australian Bureau of Meteorology" ;
  • :expt_id = "ge2_gef_reduced" ;
  • :source = "access_gef sms suite" ;
  • :platform = "ngamai" ;
  • :da_input = "access_g1" ;
  • :modl_vrsn = "APS2 ACCESS-GE" ;
  • :date_created = "2015091012" ;
  • :base_date = "20150910" ;
  • :base_time = "12" ;
  • :ensemble_member = "001" ;

Full data fields (NetCDF header summary)

  • Single level fields: ( 81x325x432 ):

  • float topog(time, lat, lon) ;

  • float sfc_pres(time, lat, lon) ;

  • float accum_ls_prcp(time, lat, lon) ;

  • float accum_ls_snow(time, lat, lon) ;

  • float u10(time, lat2, lon2) ;

  • float v10(time, lat2, lon2) ;

  • float temp_scrn(time, lat, lon) ;

  • float tmax_scrn(time, lat, lon) ;

  • float tmin_scrn(time, lat, lon) ;

  • float accum_conv_prcp(time, lat, lon) ;

  • float accum_conv_snow(time, lat, lon) ;

  • float accum_prcp(time, lat, lon) ;

  • float visibility(time, lat, lon) ;

  • float fog_fraction(time, lat, lon) ;

  • float dewpt_scrn(time, lat, lon) ;

  • float conv_cld_amt_2d(time, lat, lon) ;

  • float low_cld(time, lat, lon) ;

  • float mid_cld(time, lat, lon) ;

  • float hi_cld(time, lat, lon) ;

  • float ttl_cld(time, lat, lon) ;

  • float mslp(time, lat, lon) ;

  • Multi level fields ( 81x37x325x432)

  • float zonal_wnd(time, lvl, lat2, lon2) ;

  • float merid_wnd(time, lvl, lat2, lon2) ;

  • float omega(time, lvl, lat, lon) ;

  • float geop_ht(time, lvl, lat, lon) ;

  • float air_temp(time, lvl, lat, lon) ;

  • float relhum(time, lvl, lat, lon) ;

Missing data

There are a number of archive dates which are missing or incomplete. These affected the first periods of the archive from Dec 2013 to Sep 2015, run on Ngamai; the later Australis period does not have any missing data. In creating the reduced archive, only complete dates have been kept. There are 27 missing dates out of 649 days for the Dec 2013 to Sep 2015 period in the reduced archive:

  • 20140208
  • 20140506
  • 20140526
  • 20140703
  • 20140705
  • 20140710
  • 20140730
  • 20140918
  • 20141218
  • 20141225
  • 20141229
  • 20150201
  • 20150210
  • 20150323
  • 20150404
  • 20150522
  • 20150625
  • 20150816
  • 20151130
  • 20151202
  • 20151207
  • 20151231
  • 20160106
  • 20160107
  • 20160209
  • 20160403
  • 20160508

NCI JIRA tickets

Links

Contacts

  • Michael Naughton (michael.naughton at bom.gov.au)
  • Asri Sulaiman (asri.sulaiman at bom.gov.au)
Clone this wiki locally