New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read ACME test data #658

Closed
doutriaux1 opened this Issue Sep 16, 2014 · 28 comments

Comments

Projects
None yet
6 participants
@doutriaux1
Member

doutriaux1 commented Sep 16, 2014

on aims1
~williams13/test_data

try to read/plot all var in all files

@doutriaux1 doutriaux1 added the cdms2 label Sep 16, 2014

@doutriaux1 doutriaux1 added this to the 2.0.0 milestone Sep 16, 2014

@aashish24

This comment has been minimized.

Contributor

aashish24 commented Sep 16, 2014

@williams13 Just a reminder.. please share the data on figshare or dropbox.

@williams13

This comment has been minimized.

Contributor

williams13 commented Sep 16, 2014

Can everyone get to the dropbox: https://www.dropbox.com/home/uvcdat-archive

There should be at least two files there now. One large ACME data set and one png generating file.

-Dean

From: Aashish Chaudhary <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Tuesday, September 16, 2014 9:40 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: Dean Williams <williams13@llnl.govmailto:williams13@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

@williams13https://github.com/williams13 Just a reminder.. please share the data on figshare or dropbox.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-55772394.

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Sep 16, 2014

Dean,

The b1850c5_t2_01_climo.nc data file that you posted is another CAM5 file which suffers from the same problem with missing time data as the CAM4 and CAM5 data that I've been looking at.    That is what's causing the pipeline errors in UVCDAT:

ncdump -c b1850c5_t2_01_climo.nc

netcdf b1850c5_t2_01_climo {
dimensions:
time = 1 ;
lat = 128 ;
lon = 256 ;
lev = 30 ;
ncl4 = 1 ;
ncl5 = 1 ;
ncl6 = 1 ;
ilev = 31 ;
variables:
double time(time) ;
time:bounds = "time_bnds" ;
time:calendar = "noleap" ;
time:units = "days since 0001-01-01 00:00:00" ;
time:long_name = "time" ;
time:_FillValue = 9.96921e+36f ;

// global attributes:
:case = "ne120_f02_t12_B1850c5" ;
:source = "CAM" ;
data:

time = _ ;

@williams13

This comment has been minimized.

Contributor

williams13 commented Sep 16, 2014

This data is on the ESGF node at ORNL and Peter Caldwell is complaining that he cannot read all the data on ESGF with UV-CDAT. Is this something that we can solve to let users read the data?

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Tuesday, September 16, 2014 11:04 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: Dean Williams <williams13@llnl.govmailto:williams13@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Dean,

The b1850c5_t2_01_climo.nc data file that you posted is another CAM5 file which suffers from the same problem with missing time data as the CAM4 and CAM5 data that I've been looking at. That is what's causing the pipeline errors in UVCDAT:

ncdump -c b1850c5_t2_01_climo.nc

netcdf b1850c5_t2_01_climo {
dimensions:
time = 1 ;
lat = 128 ;
lon = 256 ;
lev = 30 ;
ncl4 = 1 ;
ncl5 = 1 ;
ncl6 = 1 ;
ilev = 31 ;
variables:
double time(time) ;
time:bounds = "time_bnds" ;
time:calendar = "noleap" ;
time:units = "days since 0001-01-01 00:00:00" ;
time:long_name = "time" ;
time:_FillValue = 9.96921e+36f ;

// global attributes:
:case = "ne120_f02_t12_B1850c5" ;
:source = "CAM" ;
data:

time = _ ;


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-55786281.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Sep 18, 2014

@painter1 @williams13 where are we at on this one?

@durack1

This comment has been minimized.

Member

durack1 commented Oct 2, 2014

While you're at it, the issue highlighted at #479 is probably also worth investigating..

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 7, 2014

@painter1 @williams13 can we close?

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 7, 2014

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in
https://github.com/UV-CDAT/staticView

@doutriaux1 doutriaux1 closed this Oct 7, 2014

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

Jeff,
Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Tuesday, October 7, 2014 5:42 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in
https://github.com/UV-CDAT/staticView


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58267954.

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 9, 2014

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics?  How did you run
the diagnostics?

The time axis in your sample file consists of one missing value. 
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely).   I've tested on such data before.

- Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:


  Jeff,

  Are you able to read the ACME CAM datasets from
  http://esg.ccs.ornl.gov<http://esg.ccs.ornl.gov/>/ with
  UVCDAT? I get a fatal error due to problems with the time axis.
  Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

  -- Tom


  From: Jeffrey Painter
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Tuesday, October 7, 2014 5:42 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  I think we can close this. For the record, UV-CDAT can now read
  and plot all variables of interest in the test datafiles we tried.
  A script to do this may be found in

  https://github.com/UV-CDAT/staticView


  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

Jeff,
I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(*arglist,**keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 4:48 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run
the diagnostics?

The time axis in your sample file consists of one missing value.
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely). I've tested on such data before.

  • Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from
http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with
UVCDAT? I get a fatal error due to problems with the time axis.
Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read
and plot all variables of interest in the test datafiles we tried.
A script to do this may be found in

https://github.com/UV-CDAT/staticView

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58575196.

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 9, 2014

I see the exact same behavior; and also with isofill which the
diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of
the diagnostics reduction functions will delete trivial axes. It's a
trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

Ok I got a super basic test that reproduces my error.

Tom is that what you get, here is the script

import cdms2

vals = [239261039241284857122685270850462023680.000000, 239261039241284857122685270850462023690.000000]

ax = cdms2.createAxis(vals,id="time")

ax.units="hours since 1"

ax.designateTime()

print ax.asComponentTime()

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:14 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff,
I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 4:48 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run
the diagnostics?

The time axis in your sample file consists of one missing value.
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely). I've tested on such data before.

  • Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from
http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with
UVCDAT? I get a fatal error due to problems with the time axis.
Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read
and plot all variables of interest in the test datafiles we tried.
A script to do this may be found in

https://github.com/UV-CDAT/staticView

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58575196.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58578862.

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the
diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of
the diagnostics reduction functions will delete trivial axes. It's a
trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58579769.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:14 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff,
I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 4:48 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run
the diagnostics?

The time axis in your sample file consists of one missing value.
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely). I've tested on such data before.

  • Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from
http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with
UVCDAT? I get a fatal error due to problems with the time axis.
Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read
and plot all variables of interest in the test datafiles we tried.
A script to do this may be found in

https://github.com/UV-CDAT/staticView

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58575196.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58578862.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:28 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the
diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of
the diagnostics reduction functions will delete trivial axes. It's a
trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58579769.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58580680.

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

Charles,
Both of your scripts give errors that look very similar to what I'm getting from the ACME box plot.
-- Tom

From: Charles <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:29 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:14 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff,
I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 4:48 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run
the diagnostics?

The time axis in your sample file consists of one missing value.
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely). I've tested on such data before.

  • Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from
http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with
UVCDAT? I get a fatal error due to problems with the time axis.
Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read
and plot all variables of interest in the test datafiles we tried.
A script to do this may be found in

https://github.com/UV-CDAT/staticView

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58575196.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58578862.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58580851.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

Ok I filed a bug report, working on it

#781

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:32 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Charles,
Both of your scripts give errors that look very similar to what I'm getting from the ACME box plot.
-- Tom

From: Charles <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:29 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:14 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff,
I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 4:48 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run
the diagnostics?

The time axis in your sample file consists of one missing value.
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely). I've tested on such data before.

  • Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from
http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with
UVCDAT? I get a fatal error due to problems with the time axis.
Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read
and plot all variables of interest in the test datafiles we tried.
A script to do this may be found in

https://github.com/UV-CDAT/staticView

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58267954.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58575196.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58578862.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58580851.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581195.

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

The actual single time value is undefined (or empty), apparently because it is a climatology.

From: Charles <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:30 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:28 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the
diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of
the diagnostics reduction functions will delete trivial axes. It's a
trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58579769.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58580680.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581030.

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 9, 2014

These are climatology files, so there is no time value.  Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value.  Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

- Jeff

On 10/9/14, 2:30 PM, Charles wrote:


  Looking into it, I think it might be some casting issue with hours
  being so big.


  Do you have any idea what time this value really is?


  Filing a bug for this and trying to fix right away


  C.



  From: Thomas Maxwell
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:28 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)


  So it looks like uvcdat/vcs can't read this ACME data without some
  prior massaging of the data.


  -- Tom


  From: Jeffrey Painter

<notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

  I see the exact same behavior; and also with isofill which the

  diagnostics uses.


  Maybe the reason why the diagnostics can handle it is that several
  of

  the diagnostics reduction functions will delete trivial axes. It's
  a

  trivial axis which causes this problem.


  - Jeff


  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

  > x.plot( s, gm )


  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58579769.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value. Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

  • Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours
being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell
<notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some
prior massaging of the data.

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several
of

the diagnostics reduction functions will delete trivial axes. It's
a

trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58579769.

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581564.

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 9, 2014

Charles, you're right.  The file at issue is not CF-compliant.  The
CF Conventions section 1.2, entry for "coordinate variable" says "

Missing values are not allowed in coordinate variables."   I think
that we should complain to someone.  Nevertheless, I think that it
would be useful if UV-CDAT could plot this data.

- Jeff

On 10/9/14, 2:37 PM, Charles wrote:


  Ok I will try to fix it, but if it’s missing can we read with
  squeeze=1? I think that’s how we solved it for the web page pngs
  generation


  From: Jeffrey Painter
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:34 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)







  These are climatology files, so there is no time value. Someone

  feels obliged to include a time axis (why, I don't know) and marks

  the time as missing because there is no time value. Those huge

  times are, almost surely, whatever random bits happened to be in

  memory.


  BTW, FWIW your shorter script fails for me too, with "Cdtime
  error:

  Invalid componet time".


  - Jeff


  On 10/9/14, 2:30 PM, Charles wrote:



  Looking into it, I think it might be some casting issue with hours

  being so big.



  Do you have any idea what time this value really is?



  Filing a bug for this and trying to fix right away



  C.




  From: Thomas Maxwell

<notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 at 2:28 PM


  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Doutriaux, Charles"

<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  So it looks like uvcdat/vcs can't read this ACME data without some

  prior massaging of the data.



  -- Tom



  From: Jeffrey Painter

<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 5:21 PM


  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL

  CORP]"

<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  I see the exact same behavior; and also with isofill which the


  diagnostics uses.



  Maybe the reason why the diagnostics can handle it is that several

  of


  the diagnostics reduction functions will delete trivial axes. It's

  a


  trivial axis which causes this problem.



  - Jeff



  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:


  > x.plot( s, gm )



  —


  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58579769.

  —


  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58580680.

  —

  Reply to this email directly or view

  it on GitHub.

  {"@context":<a class="moz-txt-link-rfc2396E"
  href="http://schema.org">"http://schema.org"</a>,"@type":"EmailMessage","description":"View
  this Issue on GitHub","action":{"@type":"ViewAction","url":<a
  class="moz-txt-link-rfc2396E"
  href="https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030">"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030"</a>,"name":"View
  Issue"}}


  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58581564.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:37 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value. Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

  • Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours
being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some
prior massaging of the data.

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several
of

the diagnostics reduction functions will delete trivial axes. It's
a

trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58579769.

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581564.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581927.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

No I mean when you read s
s=f(“PRECL”,squeeze=1)

Let me know,

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:45 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean tr

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

I guess if you go all the way to plot time, then do:

X.plot(s(squeeze=1))

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:45 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:37 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value. Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

  • Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours
being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some
prior massaging of the data.

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several
of

the diagnostics reduction functions will delete trivial axes. It's
a

trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58579769.

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581564.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581927.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58582846.

@doutriaux1

This comment has been minimized.

Member

doutriaux1 commented Oct 9, 2014

If that works I can try to see where vcs is trying to do this and put a try/except for dim 1 dims.

Nevertheless it would be nice to fix it properly

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:45 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:37 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value. Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

  • Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours
being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some
prior massaging of the data.

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several
of

the diagnostics reduction functions will delete trivial axes. It's
a

trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58579769.

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581564.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581927.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58582846.

@painter1

This comment has been minimized.

Contributor

painter1 commented Oct 9, 2014

x.plot( s(squeeze=1), gm )  works here.
- Jeff

On 10/9/14, 2:58 PM, Charles wrote:


  If that works I can try to see where vcs is trying to do this and
  put a try/except for dim 1 dims.


  Nevertheless it would be nice to fix it properly


  C.



  From: Thomas Maxwell
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:45 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help
  (same error).



  From: Charles

<notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:37 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

  Ok I will try to fix it, but if it’s missing can we read with
  squeeze=1? I think that’s how we solved it for the web page pngs
  generation


  From: Jeffrey Painter

<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM

  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

  These are climatology files, so there is no time value. Someone

  feels obliged to include a time axis (why, I don't know) and marks

  the time as missing because there is no time value. Those huge

  times are, almost surely, whatever random bits happened to be in

  memory.


  BTW, FWIW your shorter script fails for me too, with "Cdtime
  error:

  Invalid componet time".


  - Jeff


  On 10/9/14, 2:30 PM, Charles wrote:



  Looking into it, I think it might be some casting issue with hours

  being so big.



  Do you have any idea what time this value really is?



  Filing a bug for this and trying to fix right away



  C.




  From: Thomas Maxwell

<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 at 2:28 PM


  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Doutriaux, Charles"

<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  So it looks like uvcdat/vcs can't read this ACME data without some

  prior massaging of the data.



  -- Tom



  From: Jeffrey Painter

<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 5:21 PM


  To: UV-CDAT/uvcdat

<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL

  CORP]"

<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)



  I see the exact same behavior; and also with isofill which the


  diagnostics uses.



  Maybe the reason why the diagnostics can handle it is that several

  of


  the diagnostics reduction functions will delete trivial axes. It's

  a


  trivial axis which causes this problem.



  - Jeff



  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:


  > x.plot( s, gm )



  —


  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58579769.

  —


  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58580680.

  —

  Reply to this email directly or view

  it on GitHub.

  {"@context":<a class="moz-txt-link-rfc2396E"
  href="http://schema.org">"http://schema.org"</a>,"@type":"EmailMessage","description":"View
  this Issue on GitHub","action":{"@type":"ViewAction","url":<a
  class="moz-txt-link-rfc2396E"
  href="https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030">"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030"</a>,"name":"View
  Issue"}}


  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58581564.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58581927.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com//issues/658#issuecomment-58582846.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}

@ThomasMaxwell

This comment has been minimized.

Contributor

ThomasMaxwell commented Oct 9, 2014

The following script works (plot below). Great call!


import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = { 'squeeze': 1 }

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()


[cid:CF72DD69-0C82-4006-ABE8-45A86487FF18]

From: Charles <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:58 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

If that works I can try to see where vcs is trying to do this and put a try/except for dim 1 dims.

Nevertheless it would be nice to fix it properly

C.

From: Thomas Maxwell <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:45 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:37 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 at 2:34 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles" <doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value. Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

  • Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours
being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Doutriaux, Charles"
<doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some
prior massaging of the data.

-- Tom

From: Jeffrey Painter
<notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat
<reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat
<uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL
CORP]"
<thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several
of

the diagnostics reduction functions will delete trivial axes. It's
a

trivial axis which causes this problem.

  • Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

x.plot( s, gm )

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58579769.

Reply to this email directly or view it on
GitHubhttps://github.com//issues/658#issuecomment-58580680.

Reply to this email directly or view
it on GitHub.
{"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"#658 (comment)","name":"View Issue"}}


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581564.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58581927.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58582846.


Reply to this email directly or view it on GitHubhttps://github.com//issues/658#issuecomment-58584528.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment