Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem with opendap file #1475

Closed
potter2 opened this issue Aug 3, 2015 · 13 comments · Fixed by CDAT/VisTrails#58
Closed

problem with opendap file #1475

potter2 opened this issue Aug 3, 2015 · 13 comments · Fixed by CDAT/VisTrails#58
Assignees
Milestone

Comments

@potter2
Copy link

potter2 commented Aug 3, 2015

I am trying to open a file with opendap:

[7:58am] Jerrys-MBP[/Users/potter]python
Python 2.7.9 (default, May 14 2015, 11:49:00)
[GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.49)] on darwin
Type "help", "copyright", "credits" or "license" for more information.

import cdms2
f=cdms2.open('http://dataserver.nccs.nasa.gov/thredds/ncss/grid/bypass/CREATE-IP/MERRA/mon/atmos/zg.ncml')
Abort

No errors- just "Abort". The address works fine in grads.

Is this supposed to work?

@ThomasMaxwell
Copy link
Contributor

Jerry,

 I don’t know where you got that URL, but the following should work for CREATE-IP/MERRA (are you trying to access a different version of the dataset?):

f=cdms2.open('http://dataserver.nccs.nasa.gov/thredds/dodsC/bypass/CREATE-IP/MERRA/mon/atmos/zg.ncml')

— Tom

From: potter2 <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Monday, August 3, 2015 at 11:05 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Subject: [uvcdat] problem with opendap file (#1475)

[GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.49)] on darwin

@potter2
Copy link
Author

potter2 commented Aug 3, 2015

Tom,
I get the same error with your address..
Did you try it on your MAC?

Jerry

On Aug 3, 2015, at 8:30 AM, Thomas Maxwell <notifications@github.commailto:notifications@github.com> wrote:

Jerry,

I don’t know where you got that URL, but the following should work for CREATE-IP/MERRA (are you trying to access a different version of the dataset?):

f=cdms2.open('http://dataserver.nccs.nasa.gov/thredds/dodsC/bypass/CREATE-IP/MERRA/mon/atmos/zg.ncml')

— Tom

From: potter2 <notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Monday, August 3, 2015 at 11:05 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Subject: [uvcdat] problem with opendap file (#1475)

[GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.49)] on darwin


Reply to this email directly or view it on GitHubhttps://github.com//issues/1475#issuecomment-127277840.

Gerald (Jerry) Potter
NASA Goddard Space Flight Center
E-mail gerald.potter@nasa.govmailto:gerald.potter@nasa.gov
Office 28:S241
Phone 707.315.8314
Analysis and Data Consultant
Department GSFC:606.2

@ThomasMaxwell
Copy link
Contributor

Works fine for me from my Mac desktop at NASA:

import cdms2

f=cdms2.open('http://dataserver.nccs.nasa.gov/thredds/dodsC/bypass/CREATE-IP/MERRA/mon/atmos/zg.ncml')

v = f['zg']

v.shape

(432, 42, 361, 540)

From: potter2 <notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.com>
Date: Monday, August 3, 2015 at 11:36 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>
Subject: Re: [uvcdat] problem with opendap file (#1475)

Tom,
I get the same error with your address..
Did you try it on your MAC?

Jerry

On Aug 3, 2015, at 8:30 AM, Thomas Maxwell <notifications@github.commailto:notifications@github.commailto:notifications@github.com> wrote:

Jerry,

I don’t know where you got that URL, but the following should work for CREATE-IP/MERRA (are you trying to access a different version of the dataset?):

f=cdms2.open('http://dataserver.nccs.nasa.gov/thredds/dodsC/bypass/CREATE-IP/MERRA/mon/atmos/zg.ncml')

— Tom

From: potter2 <notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>
Date: Monday, August 3, 2015 at 11:05 AM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>
Subject: [uvcdat] problem with opendap file (#1475)

[GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.49)] on darwin


Reply to this email directly or view it on GitHubhttps://github.com//issues/1475#issuecomment-127277840.

Gerald (Jerry) Potter
NASA Goddard Space Flight Center
E-mail gerald.potter@nasa.govmailto:gerald.potter@nasa.govmailto:gerald.potter@nasa.gov
Office 28:S241
Phone 707.315.8314
Analysis and Data Consultant
Department GSFC:606.2


Reply to this email directly or view it on GitHubhttps://github.com//issues/1475#issuecomment-127280091.

@doutriaux1
Copy link
Contributor

@potter2 there's currently an issue with netcdf/opendap in master see: Unidata/netcdf-c#122
@dnadeau4 maybe we can try to look at this together.

@doutriaux1
Copy link
Contributor

see: Unidata/netcdf-c#122 it seems to be related to GUI creating .dodsrc
bad code is at: https://github.com/UV-CDAT/VisTrails/blob/uvcdat-master/vistrails/gui/uvcdat/esgf.py#L186-L214

@dnadeau4
Copy link
Contributor

dnadeau4 commented Aug 3, 2015

@potter2 an temporary solution is to comment out all the CURL mention in your ~/.dodsrc.

#CURL.COOKIEJAR=.dods_cookies
#CURL.SSL.VALIDATE=1
#CURL.SSL.CERTIFICATE=/home/dnadeau/.esg/credentials.pem
#CURL.SSL.KEY=/home/dnadeau/.esg/credentials.pem
#CURL.SSL.CAPATH=/home/dnadeau/.esg/certificates

@doutriaux1
Copy link
Contributor

yep confirmed:

doutriaux1@sofia:[~/build]:[6281]> ctest -j8 -R CDMS_Test_multiple_formats
Test project /Users/doutriaux1/build
    Start 26: CDMS_Test_multiple_formats
1/1 Test #26: CDMS_Test_multiple_formats .......   Passed    0.70 sec

100% tests passed, 0 tests failed out of 1

Total Test time (real) =   0.71 sec
doutriaux1@sofia:[~/build]:[6282]> mv /Users/doutriaux1/.dodsrc.old /Users/doutriaux1/.dodsrc
doutriaux1@sofia:[~/build]:[6283]> ctest -j8 -R CDMS_Test_multiple_formats
Test project /Users/doutriaux1/build
    Start 26: CDMS_Test_multiple_formats
1/1 Test #26: CDMS_Test_multiple_formats .......***Failed    0.31 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   0.31 sec

The following tests FAILED:
     26 - CDMS_Test_multiple_formats (Failed)
Errors while running CTest

@potter2
Copy link
Author

potter2 commented Aug 4, 2015

I deleted ~/.didscr and then it worked.

Thanks for finding this!

@durack1
Copy link
Member

durack1 commented Sep 2, 2015

@potter2 @doutriaux1 can this be closed?

@doutriaux1
Copy link
Contributor

no. i am waiting for esgf to be back up to implement a permanent fix that will also work for esgf auth

@doutriaux1
Copy link
Contributor

partly fixed by CDAT/VisTrails#58

@dnadeau4
Copy link
Contributor

I looked into the THREDDS case today. In CDMS2 it will be some work to return a slice of the array. The CDMS2 architecture is made to return the whole array and there is a verification where each returned axis length match the returned netCDF array shape. Maybe I can manage something in CDMS3.

@durack1
Copy link
Member

durack1 commented Sep 18, 2015

@dnadeau4 this (subsetting commentary) is associated with #1288

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants