Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test all ece mip variables #542

Open
treerink opened this issue Nov 13, 2019 · 24 comments
Open

Test all ece mip variables #542

treerink opened this issue Nov 13, 2019 · 24 comments
Assignees

Comments

@treerink
Copy link
Collaborator

Beside the production of all the control output files for the MIP experiments in which EC-Earth3 participates, genecec also produces a test-all-ece-mip-variables directory which can be used for testing all control output files in one go. Since #474 this also applies for all IFS variables. Currently EC-Earth3 runs with the test-all-ece-mip-variables active, but the cmorisation of that result is not without crashing yet.

@treerink
Copy link
Collaborator Author

treerink commented Nov 13, 2019

The first thing to overcome is to prevent ambiguous situations with two or more different amount of pressure levels for one table-var combination (this occurs because we are asking for all at the same time). The abort message is:

 ERROR:ece2cmor3.taskloader: Found duplicate output name for targets ta7h, ta27 in table 6hrPlevPt for model ifs
 ERROR:ece2cmor3.taskloader: Found duplicate output name for targets hus7h, hus27 in table 6hrPlevPt for model ifs
 ERROR:ece2cmor3.taskloader: Found duplicate output name for targets hus, hus27 in table Emon for model ifs
 ERROR:ece2cmor3.taskloader: Found duplicate output name for targets va27, va in table Emon for model ifs
 ERROR:ece2cmor3.taskloader: Found duplicate output name for targets ua, ua27 in table Emon for model ifs
 CRITICAL:ece2cmor3.taskloader: Duplicate requested variables were found, dismissing all cmorization tasks

Applying in:

cmip6-output-control-files/test-all-ece-mip-variables/ece-cmip6-data-request-varlist-all-EC-EARTH-AOGCM.json

the following changes

--- runtime/classic/ctrl/cmip6-output-control-files/test-all-ece-mip-variables/ece-cmip6-data-request-varlist-all-EC-EARTH-AOGCM.json	(revision 7287)
+++ runtime/classic/ctrl/cmip6-output-control-files/test-all-ece-mip-variables/ece-cmip6-data-request-varlist-all-EC-EARTH-AOGCM.json	(working copy)
@@ -55,7 +55,6 @@
             "tsl",
             "zg500",
             "mrsol",
-            "ta7h",
             "ts",
             "mrsos",
             "vas",
@@ -64,7 +63,6 @@
             "rv850",
             "psl",
             "ua7h",
-            "hus7h",
             "snw",
             "hus27",
             "sfcWind",
@@ -310,7 +308,6 @@
             "mrsol",
             "ta27",
             "ps",
-            "va27",
             "wap2",
             "twap",
             "rss",
@@ -318,10 +315,8 @@
             "ua",
             "u2",
             "vt",
-            "ua27",
             "v2",
             "sfcWindmax",
-            "hus27",
             "rls",
             "va",
             "tdps"

makes it possible to start running ece2cmor3 on this test-all output.

@treerink
Copy link
Collaborator Author

@goord The 6hrPlevPt mrsol seems to be the problem. I show the end of the slurm log below including the debug print (this is the finished run using 28 cores):

DEBUGGG: Starting netcdf2cmor for  3hr ps
DEBUGGG: Ending netcdf2cmor for  3hr ps
DEBUGGG: Starting netcdf2cmor for  6hrPlevPt tsl
DEBUGGG: Ending netcdf2cmor for  6hrPlevPt tsl
DEBUGGG: Starting netcdf2cmor for  6hrPlev wap4
DEBUGGG: Ending netcdf2cmor for  6hrPlev wap4
DEBUGGG: Starting netcdf2cmor for  6hrPlevPt snw
DEBUGGG: Ending netcdf2cmor for  6hrPlevPt snw
DEBUGGG: Starting netcdf2cmor for  Eday mrsol
DEBUGGG: Ending netcdf2cmor for  Eday mrsol
DEBUGGG: Starting netcdf2cmor for  Efx siltfrac
DEBUGGG: Ending netcdf2cmor for  Efx siltfrac
DEBUGGG: Starting netcdf2cmor for  3hr rsds
DEBUGGG: Ending netcdf2cmor for  3hr rsds
DEBUGGG: Starting netcdf2cmor for  Emon rls
DEBUGGG: Ending netcdf2cmor for  Emon rls
DEBUGGG: Starting netcdf2cmor for  Eday clt
DEBUGGG: Ending netcdf2cmor for  Eday clt
DEBUGGG: Starting netcdf2cmor for  CFday rldscs
DEBUGGG: Ending netcdf2cmor for  CFday rldscs
DEBUGGG: Starting netcdf2cmor for  E3hr sfcWind
DEBUGGG: Ending netcdf2cmor for  E3hr sfcWind
DEBUGGG: Starting netcdf2cmor for  day vas
DEBUGGG: Ending netcdf2cmor for  day vas
DEBUGGG: Starting netcdf2cmor for  6hrPlevPt mrsol
Traceback (most recent call last):
  File "/lustre2/projects/model_testing/reerink/miniconda2/envs/ece2cmor3/bin/ece2cmor", line 11, in <module>
    load_entry_point('ece2cmor3', 'console_scripts', 'ece2cmor')()
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ece2cmor.py", line 141, in main
    cdothreads=args.ncdo)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ece2cmorlib.py", line 186, in perform_ifs_tasks
    ifs2cmor.execute(ifs_tasks, nthreads=taskthreads)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ifs2cmor.py", line 203, in execute
    cmor_worker(task)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ifs2cmor.py", line 225, in cmor_worker
    execute_netcdf_task(task)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ifs2cmor.py", line 526, in execute_netcdf_task
    time_selection=time_selection, force_fx=(cmor_target.get_freq(task.target) == 0))
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/cmor_utils.py", line 385, in netcdf2cmor
    cmor.write(varid, vals, ntimes_passed=ntimes_passed)
  File "/lustre2/projects/model_testing/reerink/miniconda2/envs/ece2cmor3/lib/python2.7/site-packages/cmor/pywrapper.py", line 789, in write
    raise Exception("not enough data is being passed for the number of times passed")
Exception: not enough data is being passed for the number of times passed

The log ends with:

2019-11-12 20:54:30 INFO:ece2cmor3.ifs2cmor: Loading CMOR table day...
2019-11-12 20:54:40 INFO:ece2cmor3.ifs2cmor: Post-processing variable 118 for target variable mrsol...
2019-11-12 20:54:41 INFO:ece2cmor3.postproc: Post-processing target mrsol in table 6hrPlevPt from file /lustre2/projects/model_testing/reerink/temp-cmor-dir/t001/ifs/002/t001-ifs-1991/40.128.111_39.128.111.3 with cdo command -set
gridtype,regular -expr,'var118=70*var39+30*var40' -selhour,0,6,12,18 -selcode,39,40
2019-11-12 20:54:51 INFO:ece2cmor3.ifs2cmor: Cmorizing source variable 118 to target variable mrsol...
2019-11-12 20:54:51 INFO:ece2cmor3.ifs2cmor: Loading CMOR table 6hrPlevPt...
2019-11-12 20:54:51 INFO:ece2cmor3.ifs2cmor: Creating soil depth axis using variable mrsol...

@goord
Copy link
Collaborator

goord commented Nov 13, 2019

mrsol has changed after the update to drq 01.00.30 and has to be reported now for depth layers separately, in line with occurences of mrsol in other tables. This means we can simply remove the table_override block in the ifspar.json...

@goord
Copy link
Collaborator

goord commented Nov 13, 2019

@treerink I pushed the fix in 4fa9222 for mrsol, you may continue testing

@treerink
Copy link
Collaborator Author

Ok will test it.

@treerink
Copy link
Collaborator Author

treerink commented Nov 13, 2019

To be totally certain I will run the cmorisation once more, but it seems we are far now, I had no crash after the mrsol fix.

The following list of 82 errors in the log:

[reerink]{l2}>grep ERR cmorised-results/cmor-cmip-test-all/t001/ifs/001/logs/t001-ifs-001-20191113202416.log |sort -k8,8
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.ifs2cmor: Variable hus has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ps has unsupported combination of dimensions [u'latitude', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ta has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ta has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ua has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable va has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable zg has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
ERROR:ece2cmor3.postproc: Unsupported combination of frequency day with time operators ['mean where snow'] encountered
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrAnt
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrGre
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orogIs in table LImon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 246.228, level type 105, level 100. Dismissing task ua100m in table 6hrPlev
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 247.228, level type 105, level 100. Dismissing task va100m in table 6hrPlev
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target prc: code 143.128, level type 1, level 0. Dismissing task prc in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target pr: code 228.128, level type 1, level 0. Dismissing task pr in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target psl: code 151.128, level type 1, level 0. Dismissing task psl in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target rlut: code 179.128, level type 1, level 0. Dismissing task rlut in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ta27: code 130.128, level type 210, level 100000. Dismissing task ta27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ua27: code 131.128, level type 210, level 100000. Dismissing task ua27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target va27: code 132.128, level type 210, level 100000. Dismissing task va27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target wap: code 135.128, level type 210, level 85000. Dismissing task wap in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target zg27: code 129.128, level type 210, level 100000. Dismissing task zg27 in table E1hr
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency yr with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency yr with time operators ['mean where ice_sheet'] encountered

The Unsupported combination of frequency * with time operators message comes from postproc.py.

@treerink
Copy link
Collaborator Author

From the nemo test-all exercise I get an error now:

/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/cmor_utils.py:271: RuntimeWarning: divide by zero encountered in long_scalars
  size = ncvar.size / ntimes
Traceback (most recent call last):
  File "/lustre2/projects/model_testing/reerink/miniconda2/envs/ece2cmor3/bin/ece2cmor", line 11, in <module>
    load_entry_point('ece2cmor3', 'console_scripts', 'ece2cmor')()
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ece2cmor.py", line 143, in main
    ece2cmorlib.perform_nemo_tasks(args.datadir, args.exp, refdate)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/ece2cmorlib.py", line 199, in perform_nemo_tasks
    nemo2cmor.execute(nemo_tasks)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/nemo2cmor.py", line 136, in execute
    execute_netcdf_task(dataset, task)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/nemo2cmor.py", line 240, in execute_netcdf_task
    mask=mask)
  File "/nfs/home/users/reerink/cmorize/ece2cmor3/ece2cmor3/cmor_utils.py", line 272, in netcdf2cmor
    chunk = int(math.floor(4.0E+9 / (8 * size)))  # Use max 4 GB of memory
ZeroDivisionError: float division by zero

@treerink
Copy link
Collaborator Author

The log ended with Oyr ocontempdiff end indeed when using:

ece2cmor3/resources/test-data-request/varlist-nemo-Oyr-ocontempdiff.json

The error is reproduced.

@treerink
Copy link
Collaborator Author

treerink commented Nov 15, 2019

The error is the same as in #493 and looking into the raw NEMO output file (t001_1y_19900101_19901231_opa_grid_T_3D.nc) I can see it contains the variables mentioned in #493. Actually it is the same issue, see the list in that issue.

The ncdump of t001_1y_19900101_19901231_opa_grid_T_3D.nc shows:

time_counter = UNLIMITED ; // (0 currently)

Note Emon ocontempdiff is cmorised, though be it with only invalid values.

@treerink
Copy link
Collaborator Author

After removing the same list of problematic variables from the test-all list as in #493, the test-all for NEMO runs, 175 variables are cmorised and the following list of errors is reported in the log file:

more t001-nemo-001-20191118124843.log|grep ERR|sort -k2,2
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table SImon was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table Omon  was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task
ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrblo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrelo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrxylo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvho
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvtrto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkevfo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkexyfo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnkebto2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnpeo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable zhalfo
ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d          in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmo               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmto              in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvtrto             in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d         in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable zhalfo               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.cmor_utils: File path /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/ofx-data/subbasins.nc does not contain a grid string
ERROR:ece2cmor3.nemo2cmor: The grid lim_grid_1point consists of a single point which is not supported, dismissing variables siarean in SImon,siareas in SImon,siextentn in SImon,siextents in SImon,sivoln in SImon,sivols in SImon
ERROR:ece2cmor3.nemo2cmor: The grid opa_grid_1point consists of a single point which is not supported, dismissing variables bigthetaoga in Omon,masso in Omon,soga in Omon,sosga in Omon,thetaoga in Omon,tosga in Omon,volo in Omon,zostoga in Omon
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1d_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead

Most of them are known and reported in #500 under point 1, 2 and 3.

However, note the two first errors for sfdsi and the subbasins.nc related error:

ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table SImon was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table Omon  was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task

ERROR:ece2cmor3.cmor_utils: File path /lustre2/projects/model_testing/reerink/ec-earth-3/branch-r7144-control-output-files/t001/output/nemo/ofx-data/subbasins.nc does not contain a grid string

treerink added a commit that referenced this issue Nov 20, 2019
…n the 2nd post of #542. In comment the json data request exceptions for #493 & #504 are added.
@goord
Copy link
Collaborator

goord commented Jan 16, 2020

@treerink and @plesager the zonal means for IFS variables have been implemented in the branch zonal_means, you can test them on your dataset

@goord
Copy link
Collaborator

goord commented Jan 17, 2020

@plesager I merged the latest master into the zonal means branch for testing

@plesager
Copy link
Contributor

No success with the zonal_means branch . Here's the log, in case that gives you a clue. It crashes quite early:

Traceback (most recent call last):
File "/lustre2/projects/model_testing/sager/miniconda2/envs/ece2cmor3/bin/ece2cmor", line 11, in
load_entry_point('ece2cmor3', 'console_scripts', 'ece2cmor')()
File "/nfs/home/users/sager/cmorize/ece2cmor3/ece2cmor3/ece2cmor.py", line 123, in main
check_duplicates=True)
File "/nfs/home/users/sager/cmorize/ece2cmor3/ece2cmor3/taskloader.py", line 67, in load_tasks
matches = load_vars(variables, asfile=(isinstance(variables, basestring) and os.path.isfile(variables)))
File "/nfs/home/users/sager/cmorize/ece2cmor3/ece2cmor3/taskloader.py", line 93, in load_vars
modeldict = json.loads(vartext)
File "/lustre2/projects/model_testing/sager/miniconda2/envs/ece2cmor3/lib/python2.7/json/init.py", line 339, in loads
return _default_decoder.decode(s)
File "/lustre2/projects/model_testing/sager/miniconda2/envs/ece2cmor3/lib/python2.7/json/decoder.py", line 364, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/lustre2/projects/model_testing/sager/miniconda2/envs/ece2cmor3/lib/python2.7/json/decoder.py", line 380, in raw_decode
obj, end = self.scan_once(s, idx)
ValueError: Expecting property name: line 6 column 5 (char 68)

@goord
Copy link
Collaborator

goord commented Jan 17, 2020

Looks like an error in your varlist file formatting...

@treerink
Copy link
Collaborator Author

Check your file with:
https://jsonformatter.curiousconcept.com/

@plesager
Copy link
Contributor

Ok, fixed json, file, got correct results for ta {AERmonZ} .

@treerink
Copy link
Collaborator Author

Current test-all NEMO error overview:

more ~/l2/cmorised-results/cmor-cmip-test-all-23/t001/nemo/001/logs/t001-nemo-001-20200122091513.log |grep ERROR|sort -k2,2 > nemo-cmorisation-error-overview.txt

ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table SImon was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table Omon was found in multiple NEMO output files /lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc,/lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1m_19900101_19901231_opa_grid_T_2D.nc... dismissing task
ERROR:ece2cmor3.nemo2cmor: Variable talknat              in table Omon       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dissicnat            in table Omon       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable bigthetao
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable bigthetaoga
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable hfbasin
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable hfds
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable masscello
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable masso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable msftyz
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sfdsi
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable so
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable soga
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sos
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sosga
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tauuo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tauvo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thetao
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thetaoga
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thkcello
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tos
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tosga
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable uo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable vo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable volo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable wfo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable wo
ERROR:ece2cmor3.nemo2cmor: Variable bigthetaoga          in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable bigthetao            in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dissicnat            in table Oyr        was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable hfbasin              in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable hfds                 in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable masscello            in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable masso                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable msftyz               in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable sfdsi                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable soga                 in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable so                   in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable sosga                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable sos                  in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable talknat              in table Oyr        was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tauuo                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tauvo                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable thetaoga             in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable thetao               in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable thkcello             in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tosga                in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tos                  in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable uo                   in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable vo                   in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable volo                 in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable wfo                  in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable wo                   in table Odec       was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrblo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrelo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrxylo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvho
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvtrto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkevfo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkexyfo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnkebto2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnpeo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable zhalfo
ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d          in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmo               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmto              in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvtrto             in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d         in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable zhalfo               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: The grid opa_grid_1point consists of a single point which is not supported, dismissing variables thetaoga in Omon,sosga in Omon,zostoga in Omon,volo in Omon,tosga in Omon,bigthetaoga in Omon,masso in Omon,soga in Omon
ERROR:ece2cmor3.nemo2cmor: The grid lim_grid_1point consists of a single point which is not supported, dismissing variables siarean in SImon,sivols in SImon,siareas in SImon,sivoln in SImon,siextents in SImon,siextentn in SImon
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre2/projects/model_testing/reerink/ec-earth-3/trunk/t001/output/nemo/001/t001_1d_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead

@treerink
Copy link
Collaborator Author

treerink commented Jan 22, 2020

Current test-all IFS error overview:

m ~/l2/cmorised-results/cmor-cmip-test-all-23/t001/ifs/001/logs/t001-ifs-001-20200122091513.log |grep ERROR|sort -k2,1 > ifs-cmorisation-error-overview.txt

ERROR:ece2cmor3.grib_filter: Field has too low frequency for target prc: code 143.128, level type 1, level 0. Dismissing task prc in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target pr: code 228.128, level type 1, level 0. Dismissing task pr in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target psl: code 151.128, level type 1, level 0. Dismissing task psl in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target rlut: code 179.128, level type 1, level 0. Dismissing task rlut in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ta27: code 130.128, level type 210, level 100000. Dismissing task ta27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ua27: code 131.128, level type 210, level 100000. Dismissing task ua27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target va27: code 132.128, level type 210, level 100000. Dismissing task va27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target wap: code 135.128, level type 210, level 85000. Dismissing task wap in table E1hr
ERROR:ece2cmor3.grib_filter: Field has too low frequency for target zg27: code 129.128, level type 210, level 100000. Dismissing task zg27 in table E1hr
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrAnt
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrGre
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orogIs in table LImon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 246.228, level type 105, level 100. Dismissing task ua100m in table 6hrPlev
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 247.228, level type 105, level 100. Dismissing task va100m in table 6hrPlev
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency day with time operators ['mean where snow'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency mon with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency yr with time operators ['mean where ice_sheet'] encountered
ERROR:ece2cmor3.postproc: Unsupported combination of frequency yr with time operators ['mean where ice_sheet'] encountered

@goord
Copy link
Collaborator

goord commented Jan 22, 2020

Created a new branch mean_mask to address the ice_sheet masked variables

@treerink
Copy link
Collaborator Author

treerink commented May 7, 2020

Latest test-all NEMO error overview (including comparison with previous states):

 more /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-nemo-001-20200506102418.log |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-nemo-001-20200506102418.log-errors-sorted

 With most recent comparison:
 more /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-nemo-001-20200423173712.log |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-nemo-001-20200423173712.log-errors-sorted
 meld /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-nemo-001-20200423173712.log-errors-sorted /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-nemo-001-20200506102418.log-errors-sorted
 With an earlier comparison:
 more /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/nemo/001/logs/t001-nemo-001-20200124132513.log |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/nemo/001/logs/t001-nemo-001-20200124132513.log-errors-sorted
 meld /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/nemo/001/logs/t001-nemo-001-20200124132513.log-errors-sorted /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-nemo-001-20200506102418.log-errors-sorted


 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable bigthetao
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable bigthetaoga
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable hfbasin
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable hfds
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable masscello
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable masso
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable msftyz
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sfdsi
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable so
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable soga
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sos
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable sosga
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tauuo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tauvo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thetao
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thetaoga
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable thkcello
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tos
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable tosga
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable uo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable vo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable volo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable wfo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency dec     with a nemo output frequency for variable wo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrblo2d
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrelo2d
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrxylo2d
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvho
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmto
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvso
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvtrto
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkevfo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkexyfo2d
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnkebto2d
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnpeo
 ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable zhalfo
 ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1d_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
 ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1m_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
 ERROR:ece2cmor3.nemo2cmor: The grid lim_grid_1point consists of a single point which is not supported, dismissing variables siarean in SImon,sivols in SImon,siareas in SImon,sivoln in SImon,siextents in SImon,siextentn in SImon
 ERROR:ece2cmor3.nemo2cmor: The grid opa_grid_1point consists of a single point which is not supported, dismissing variables thetaoga in Omon,sosga in Omon,zostoga in Omon,volo in Omon,tosga in Omon,bigthetaoga in Omon,masso in Omon,soga in Omon
 ERROR:ece2cmor3.nemo2cmor: Variable bigthetaoga          in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable bigthetao            in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d           in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d           in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d          in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable difvmo               in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable difvmto              in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable difvtrto             in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo            in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d         in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable dissicnat            in table Omon       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable dissicnat            in table Oyr        was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable hfbasin              in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable hfds                 in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable masscello            in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable masso                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable msftyz               in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable sfdsi                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table Omon was found in multiple NEMO output files /lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1m_19900101_19901231_opa_grid_T_2D.nc,/lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1m_19900101_19901231_lim_grid_T_2D.nc... dismissing task
 ERROR:ece2cmor3.nemo2cmor: Variable sfdsi needed for sfdsi in table SImon was found in multiple NEMO output files /lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1m_19900101_19901231_opa_grid_T_2D.nc,/lustre3/projects/CMIP6/reerink/ec-earth-3/trunk/t004/output/nemo/001/t004_1m_19900101_19901231_lim_grid_T_2D.nc... dismissing task
 ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline     in table SImon      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline     in table SImon      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable soga                 in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable so                   in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable sosga                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable sos                  in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable talknat              in table Omon       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable talknat              in table Oyr        was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tauuo                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tauvo                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable thetaoga             in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable thetao               in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable thkcello             in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d            in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oclim      was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tosga                in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable tos                  in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable uo                   in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable vo                   in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable volo                 in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable wfo                  in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable wo                   in table Odec       was not found in the NEMO output files: task skipped.
 ERROR:ece2cmor3.nemo2cmor: Variable zhalfo               in table Oclim      was not found in the NEMO output files: task skipped.

@treerink
Copy link
Collaborator Author

treerink commented May 7, 2020

Latest test-all IFS error overview (including comparison with previous states):

 more /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-ifs-001-20200506102418.log  |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-ifs-001-20200506102418.log-errors-sorted

 With most recent comparison:
 more /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-ifs-001-20200423173712.log  |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-ifs-001-20200423173712.log-errors-sorted
 meld /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-12/t003/logs/t003-ifs-001-20200423173712.log-errors-sorted /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-ifs-001-20200506102418.log-errors-sorted
 With an earlier comparison:
 more /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/ifs/001/logs/t001-ifs-001-20200124132513.log  |sed -e 's/2020-..-.. ..:..:..//'| grep ERROR|sort -k2,2 >  /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/ifs/001/logs/t001-ifs-001-20200124132513.log-errors-sorted
 meld /lustre2/projects/model_testing/reerink/cmorised-results/cmor-cmip-test-all-24/t001/ifs/001/logs/t001-ifs-001-20200124132513.log-errors-sorted /lustre3/projects/CMIP6/reerink/cmorised-results/cmor-cmip-test-all-t004-01/t004/logs/t004-ifs-001-20200506102418.log-errors-sorted

 
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target prc: code 143.128, level type 1, level 0. Dismissing task prc in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target pr: code 228.128, level type 1, level 0. Dismissing task pr in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target psl: code 151.128, level type 1, level 0. Dismissing task psl in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target rlut: code 179.128, level type 1, level 0. Dismissing task rlut in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ta27: code 130.128, level type 210, level 100000. Dismissing task ta27 in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target ua27: code 131.128, level type 210, level 100000. Dismissing task ua27 in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target va27: code 132.128, level type 210, level 100000. Dismissing task va27 in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target wap: code 135.128, level type 210, level 85000. Dismissing task wap in table E1hr
 ERROR:ece2cmor3.grib_filter: Field has too low frequency for target zg27: code 129.128, level type 210, level 100000. Dismissing task zg27 in table E1hr
 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrAnt
 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrGre
 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orogIs in table LImon
 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 246.228, level type 105, level 100. Dismissing task ua100m in table 6hrPlev
 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 247.228, level type 105, level 100. Dismissing task va100m in table 6hrPlev
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonAnt is not supported
 ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonGre is not supported
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered for variable rlutcs in table E1hrClimMon
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered for variable rlut in table E1hrClimMon
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered for variable rsdt in table E1hrClimMon
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered for variable rsutcs in table E1hrClimMon
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency 1hrCM with time operators ['mean within days', 'mean over days'] encountered for variable rsut in table E1hrClimMon
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable hfls in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable hfss in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable huss in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable prc in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable pr in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable prw in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable ps in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable rlut in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable rsdt in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable rsut in table Esubhr
 ERROR:ece2cmor3.postproc: Unsupported combination of frequency subhrPt with time operators ['point'] encountered for variable tas in table Esubhr

@treerink
Copy link
Collaborator Author

treerink commented Dec 1, 2020

Latest tests (see https://dev.ec-earth.org/issues/895#note-36) are still in agreement with the posts above.

Reminder for next test: my local compare-cmorise-test-all-case.sh script, facilitates this comparison work.

@treerink
Copy link
Collaborator Author

Latest remaining test-all NEMO error overview:

more /lustre3/projects/CMIP6/reerink/cmorised-results/test-all-r10104-output-control-files/t001/v003/logs/sorted-log-errors-leg-001.nemo

gives

ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre3/projects/CMIP6/reerink/ec-earth-3/r10104-output-control-files/t001/output/nemo/001/t001_1d_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /lustre3/projects/CMIP6/reerink/ec-earth-3/r10104-output-control-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
ERROR:ece2cmor3.nemo2cmor: The grid lim_grid_1point consists of a single point which is not supported, dismissing variables siarean in SImon,siareas in SImon,siextentn in SImon,siextents in SImon,sivoln in SImon,sivols in SImon
ERROR:ece2cmor3.nemo2cmor: The grid opa_grid_1point consists of a single point which is not supported, dismissing variables bigthetaoga in Omon,masso in Omon,soga in Omon,sosga in Omon,thetaoga in Omon,tosga in Omon,volo in Omon,zostoga in Omon

@treerink
Copy link
Collaborator Author

Latest test-all IFS error overview:

more /lustre3/projects/CMIP6/reerink/cmorised-results/test-all-r10104-output-control-files/t001/v003/logs/sorted-log-errors-leg-001.ifs

gives

ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrAnt
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orog in table IyrGre
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 129.128, level type 1, level 0. Dismissing task orogIs in table LImon
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfls in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task hfss in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prra in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task prsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rlus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task rsus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task sbl in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snc in table IyrGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task snm in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tas in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task ts in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Latitude reduction operator for task tsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfls in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task hfss in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prra in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task prsn in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rlus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsds in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task rsus in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task sbl in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snc in table IyrGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task snm in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tas in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task ts in table ImonGre is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonAnt is not supported
ERROR:ece2cmor3.postproc: Longitude reduction operator for task tsn in table ImonGre is not supported

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants