ESMF conservative blending when you have missing values

[doutriaux1]

I'm using the following cdms2 on Linux
cdms2 2.12.2018.02.22.17.40.g09431cb.npy1.13 py27_0 uvcdat/label/nightly

@gleckler1 @durack1 feel free to chime in

code:

from __future__ import print_function
import cdms2, vcs, MV2
import os

data = cdms2.open("data.nc")("ta")
print(data.shape)

tmp = cdms2.open("sft.nc")
sft = tmp("sftlf")
tmp.close()

data2 = MV2.masked_where(MV2.less(sft,50.),data)

tGrid = cdms2.createUniformGrid(-88.875, 72, 2.5, 0, 144, 2.5)
x=vcs.init()
for mthd in ["conservative", "linear"]:
    print("USING REGRID METHOD:",mthd)
    data3 = data2.regrid(tGrid, regridTool="esmf", regridMethod=mthd)
    print("pltting")
    x.plot(data3)
    print("pnging")
    x.png("masked_{}".format(mthd))
    print("clearing")
    x.clear()

produce:

Data files:

data.zip

[durack1]

@doutriaux1 I have also seen the same thing, which was a concern to me - @dnadeau4 are there toggles/keywords that we can load up the ESMPy call with to control such behaviour?

[dnadeau4]

@doutriaux1 is this for py3 only?

[gleckler1]

@dnadeau4 @doutriaux1 @durack1 The maps above would explain the ESMF conservative results we've been getting with PMP which so far is only py2.7. It is great that we are getting to the bottom of this!

[doutriaux1]

@dnadeau4 as @gleckler1 mentioned py2, probably/hopefully py3 as well.

[doutriaux1]

@dnadeau4 from your comments at the meeting, it looks like your'e regriding the mask, I think we need to err on the safe side and mask every cell where there is any fraction of mask, possibly add a threshold keywork to let the user control what the threshold should be before considering a cell as masked or not.

[dnadeau4]

It seems that everything is working well, when I look at the input data.

[doutriaux1]

@dnadeau4 yes input data are fine, it's the output that is an issue.

[dnadeau4]

Not really, look there is data in Antarctica.

[dnadeau4]

The values seem high, is that what you meant?

[doutriaux1]

yes something is going on, the 2 pictures look really different