Segfault in cmor.write during source_id validation

[durack1]

I'm getting a persistent segfault during the cmor.write call, with a gdb suggesting the issue is in:

(gdb) bt
#0  0x0000003cf37285e4 in __strchr_sse42 () from /lib64/libc.so.6
#1  0x00007fffa3c0f28b in cmor_CV_checkSourceID ()
   from /export/duro/anaconda2/envs/cmor330/lib/python2.7/site-packages/cmor/_cmor.so
#2  0x00007fffa3c0b0dc in cmor_setGblAttr ()
   from /export/duro/anaconda2/envs/cmor330/lib/python2.7/site-packages/cmor/_cmor.so

I've had problems determining where the problem is occurring, so have replicated the setup at:

crunch:/work/durack1/Shared/160427_CMIP6_Forcing/OMIP

Running runCmorDemo.py in that directory should reproduce the error, all table files and input files are specified within this python script

[durack1]

@dnadeau4 if you have cmor time today, it'd be great to get to the bottom of this issue

[taylor13]

one thought is: Is there a hardwired limit to the size of an array CMOR can write in one call to cmor_write? I think the file being treated exceeds 2 gigabytes.

Also check that the type of the dimensions is properly defined as "double".

[durack1]

@taylor13 you're right, the array is very near that 2GB size and is stored as a float in the source file, so at double precision, will be a fair bit larger than 2GB

[dnadeau4]

fixed. You did not set your source properly in you CV file.

        "source_id":{
            "MRI-JRA55-do-1-3":{
                "source": "MRI JRA55-do 1.3: Atmospheric state generated for OMIP based on the MRI JRA55 reanalysis"
             },
            "PCMDI":{ "source":"PCMDI:"}

[dnadeau4]

adb1435