vistrails module uvcdat_cdms missing #581

doutriaux1 · 2014-08-28T20:59:34Z

Jim's UVCDAT GUI fils loading in a variable

Going back commit after commit, we found that the breaking point was introduced between the follwing 2 commits. I guess @ThomasMaxwell you need to look into this.


commit 03624da5ff3c03cf6d0128de0ffd331266d10b98
Author: Thomas Maxwell <thomas.maxwell@nasa.gov>
Date:   Mon Aug 18 18:02:02 2014 -0400

    Parameter fixes

commit 5e6ac22be23c7bbf360b16676f8eb6da83d1ea30
Merge: b4dceec 0f17b6b
Author: Thomas Maxwell <thomas.maxwell@nasa.gov>
Date:   Mon Aug 18 16:32:08 2014 -0400

The text was updated successfully, but these errors were encountered:

ThomasMaxwell · 2014-08-28T21:45:31Z

I'll need more info on this issue. I've been using uvcdat-next and I don't see any problems with loading variables.

-- Tom

From: Charles <notifications@github.com mailto:notifications@github.com>
Reply-To: UV-CDAT/uvcdat <reply@reply.github.com mailto:reply@reply.github.com>
Date: Thursday, August 28, 2014 4:59 PM
To: UV-CDAT/uvcdat <uvcdat@noreply.github.com mailto:uvcdat@noreply.github.com>
Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" <thomas.maxwell@nasa.gov mailto:thomas.maxwell@nasa.gov>
Subject: [uvcdat] vistrails module uvcdat_cdms missing (#581)

Jim's UVCDAT GUI fils loading in a variable

Going back commit after commit, we found that the breaking point was introduced between the follwing 2 commits. I guess @ThomasMaxwellhttps://github.com/ThomasMaxwell you need to look into this.

commit 03624da
Author: Thomas Maxwell <thomas.maxwell@nasa.gov mailto:thomas.maxwell@nasa.gov>
Date: Mon Aug 18 18:02:02 2014 -0400

Parameter fixes

commit 5e6ac22be23c7bbf360b16676f8eb6da83d1ea30
Merge: b4dceec 0f17b6b
Author: Thomas Maxwell <thomas.maxwell@nasa.gov mailto:thomas.maxwell@nasa.gov>
Date: Mon Aug 18 16:32:08 2014 -0400

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/581.

doutriaux1 · 2014-09-02T20:51:44Z

I now get this as well....
here's the rror message:

Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/gui/uvcdat/variable.py", line 594, in defineVarCloseClicked
    self.getUpdatedVarCheck()
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/gui/uvcdat/variable.py", line 630, in getUpdatedVarCheck
    self.getUpdatedVar(tid)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/gui/uvcdat/variable.py", line 729, in getUpdatedVar
    updatedVar = controller.create_exec_new_variable_pipeline(targetId)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/gui/uvcdat/project_controller.py", line 1185, in create_exec_new_variable_pipeline
    self.get_var_module(targetId, dummyCell, CDMSPipelineHelper)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/gui/uvcdat/project_controller.py", line 925, in get_var_module
    module = var.to_module(self.vt_controller)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/uvcdat_cdms/init.py", line 144, in to_module
    module = Variable.to_module(self, controller, identifier)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/uvcdat/init.py", line 57, in to_module
    reg.get_descriptor_by_name(pkg_identifier, self.__class__.__name__))
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/modules/module_registry.py", line 745, in get_descriptor_by_name
    raise MissingPackage(identifier)
MissingPackage: Missing package: gov.llnl.uvcdat.cdms

doutriaux1 · 2014-09-02T20:55:39Z

and going back to your sha1 does not solve the issue.... No idea what is going on here....

aashish24 · 2014-09-02T21:01:56Z

I am not able to re-create this problem on my end

aashish24 · 2014-09-02T21:02:13Z

may be you want to send the .uvcdat folder to @dakoop

doutriaux1 · 2014-09-02T21:03:18Z

I think I'm onto something:
in vistrails/gui/application.py
i see:

        # BAB only load certain packages if requirements are met
        pkgs = [
            'uvcdat',
            'uvcdat_cdms'
        ]

        from packages.ParaView import package_requirements as paraview_requirements
        try:
            paraview_requirements()
            pkgs.append('ParaView')
            pkgs.append('pvclimate')
            pkgs.append('vtk')
#            pkgs.append('vtDV3D')
            pkgs.append('vis_analytics')
            pkgs.append('scikit_learn')
        except Exception:
            pass

        from packages.VisIt.info import package_requirements as visit_requirements
        try:
            visit_requirements()
            pkgs.append('VisIt')
        except Exception:
            pass
        self.vistrailsStartup.init()

essentially pkgs is never used. that's probably why.
@dakoop @remram44 do you know what's going on here? If I uncomment

#        self.vistrailsStartup.set_needed_packages(pkgs)

then it complians there's no such function.

Thanks for pointers.

aashish24 · 2014-09-02T21:05:13Z

I believe this code is not there in uvcdat-master. Make sure you are using the current vistails uvcdat-master.

remram44 · 2014-09-02T21:08:15Z

I removed that in 174d1ea5 for #520, I'm not sure where you're seeing this.

doutriaux1 · 2014-09-02T21:09:30Z

@aashish24 I don't think it has to do with .uvcdat. I removed it and it still does that. BUT when launching uvcdatI don't see the bits that says init uvcdaT_cdms (I think i used to):

doutriaux1@sofia:[/lgm/uvcdat/2014-09-02-devel/vistrails]:[1832]> uvcdat --output=""
UVCDAT setup already sourced for this install location.
Init package:  edu.utah.sci.vistrails.basic
ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b3f70870): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b6188b60): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

Adding VCS element: 3d_vector default 
ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b62b7e90): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b63cf7b0): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

Adding VCS element: 3d_scalar default 
ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b6501df0): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b61bc040): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

Adding VCS element: 3d_scalar xyt 
ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b64dd2a0): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b6376d90): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b620fdd0): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b3e98d90): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b67c8150): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b68dfa80): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b3edd350): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

ERROR: In /Users/doutriaux1/build_devel/build/VTK/IO/Image/vtkJPEGReader.cxx, line 142
vtkJPEGReader (0x7f97b3da3e10): Unable to open file /lgm/uvcdat/2014-09-02-devel/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/DV3D/data/buttons/BasemapOpacity.jpeg

2014-09-02 14:08:38.058 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
2014-09-02 14:08:38.058 Python[10292:d07] CoreText performance note: Set a breakpoint on CTFontLogSuboptimalRequest to debug.
2014-09-02 14:08:38.110 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
2014-09-02 14:08:38.203 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
FOR NOW STILL READING IN OLD WAY
FOR NOW STILL READING IN OLD WAY
2014-09-02 14:08:39.228 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
['Adelon', 'Arabic', 'AvantGarde', 'Chinese', 'Clarendon', 'Courier', 'Greek', 'Hebrew', 'Helvetica', 'Maths1', 'Maths2', 'Maths3', 'Maths4', 'Russian', 'Times', 'default']
Init package:  edu.utah.sci.vistrails.basic
Init package:  edu.utah.sci.vistrails.pythoncalc
Init package:  edu.utah.sci.vistrails.spreadsheet
2014-09-02 14:08:45.410 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
Init package:  edu.utah.sci.vistrails.http
Init package:  edu.utah.sci.vistrails.dialogs
Init package:  edu.utah.sci.vistrails.vtk
Generic Warning: In /Users/doutriaux1/build_devel/build/VTK/Rendering/OpenGL/vtkOpenGLPolyDataMapper.cxx, line 69
vtkOpenGLPolyDataMapper::vtkOpenGLPolyDataMapper was deprecated for VTK 6.2 and will be removed in a future version.

Warning: In /Users/doutriaux1/build_devel/build/VTK/Common/Math/vtkFastNumericConversion.cxx, line 60
vtkFastNumericConversion (0x7f97b3a71a40): Class vtkFastNumericConversion was depecated for VTK 6.0 and will be removed in a future version.

Generic Warning: In /Users/doutriaux1/build_devel/build/VTK/Rendering/OpenGL/vtkOpenGLPolyDataMapper.cxx, line 69
vtkOpenGLPolyDataMapper::vtkOpenGLPolyDataMapper was deprecated for VTK 6.2 and will be removed in a future version.

PVClimate plots not loaded.
Error when loading package_config_file: /lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plots/PVClimate/registry.cfg No module named paraview.simple
Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plotmanager.py", line 105, in load_plots
    helper = self.parse_helper_type_str(pkg_parser.get(p, 'helper'))
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plotmanager.py", line 80, in parse_helper_type_str
    module = __import__(path, globals(), locals(), [klass_name])
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/pvclimate/pvclimate_pipeline_helper.py", line 25, in <module>
    from pvgenericcell import *
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/pvclimate/pvgenericcell.py", line 12, in <module>
    import paraview.simple as pvsp
ImportError: No module named paraview.simple
VisIt plots not loaded.
Error when loading package_config_file: /lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plots/VisIt/registry.cfg No module named visit
Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plotmanager.py", line 105, in load_plots
    helper = self.parse_helper_type_str(pkg_parser.get(p, 'helper'))
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/uvcdat/plotmanager.py", line 80, in parse_helper_type_str
    module = __import__(path, globals(), locals(), [klass_name])
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/VisIt/visit_pipeline_helper.py", line 23, in <module>
    import visitcell
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/VisIt/visitcell.py", line 23, in <module>
    import visit
ImportError: No module named visit
2014-09-02 14:08:51,758 CRITICAL:
/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/pylab/init.py, line 53
Exception: Installation of python package 'matplotlib' failed.
Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 70, in py_import
    result = _vanilla_import(module_name)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 60, in _vanilla_import
    return __import__(module_name, globals(), locals(), [])
ImportError: No module named matplotlib

2014-09-02 14:08:51,758 CRITICAL:
/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/pylab/init.py, line 53
Exception: Installation of python package 'matplotlib' failed.
Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 70, in py_import
    result = _vanilla_import(module_name)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 60, in _vanilla_import
    return __import__(module_name, globals(), locals(), [])
ImportError: No module named matplotlib

CRITICAL
2014-09-02 14:08:51,758
/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/packages/pylab/init.py, line 53
Exception: Installation of python package 'matplotlib' failed.
Traceback (most recent call last):
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 70, in py_import
    result = _vanilla_import(module_name)
  File "/lgm/uvcdat/2014-09-02-devel/vistrails/vistrails/core/bundles/pyimport.py", line 60, in _vanilla_import
    return __import__(module_name, globals(), locals(), [])
ImportError: No module named matplotlib

   ------ Loaded plot Histogram, varnum = 1 ------ 
2014-09-02 14:08:51.947 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.
2014-09-02 14:08:52.066 Python[10292:d07] CoreText performance note: Client called CTFontCreateWithName() using name "Arial" and got font with PostScript name "ArialMT". For best performance, only use PostScript names when calling this API.

doutriaux1 · 2014-09-02T21:10:40Z

@aashish24 you're right this code is not there anymore. I was looking at the sha1 of the "working" (not) one in this thread. What happened to this code? Where did it go?

doutriaux1 · 2014-09-02T21:11:36Z

fresh build this morning for jim made it disappear for him. Fresh build for me made it appear (both caes on macs 10.9.4)

doutriaux1 · 2014-09-02T21:35:04Z

@remram44 b86b91e works for me

doutriaux1 · 2014-09-02T21:37:09Z

so does 174d1ea

doutriaux1 · 2014-09-02T21:38:51Z

ok now switching back to uvcdat-master it works... That's like black magic.

doutriaux1 · 2014-09-02T21:40:53Z

I have absolutely no idea what is going on here... Both Jim and I had this appear and disappear

aashish24 · 2014-09-02T21:51:29Z

this code was not required and Remi removed it.

doutriaux1 · 2014-09-02T22:12:48Z

by the way this code IS in uvcdat-next....

doutriaux1 · 2014-09-02T22:13:19Z

is there a branch that was merged inappropriately?

doutriaux1 · 2014-09-02T22:17:45Z

doutriaux1@sofia:[/lgm/uvcdat/2014-09-02-devel/vistrails]:[uvcdat-next]:[1803]> git branch --no-merged
uvcdat-520-fix-dependencies
uvcdat-520-suppress-gui-errors
uvcdat-579-fix-animate-signals

doutriaux1 · 2014-09-02T22:18:12Z

@remram44 should I merge both 520 issues into uvcdat-next? or just one? which one?

remram44 · 2014-09-03T14:13:43Z

It's really difficult for me to follow your Git workflow.

The only thing I can see right now is uvcdat-520-fix-loaded-pkgs which is in uvcdat-master but not uvcdat-next.

doutriaux1 · 2014-09-03T15:50:05Z

cool! I think that's all i needed to know will merge uvcdat-520-fix-loaded-pkgs into uvcdat-next now. Thanks again.

Workflow is as follow:
1- start from uvcdat-master
2- do your bug fixes, push into your own branch
3- merge your branch into uvcdat-next
4- ask for your branch to be merged into uvcdat-master once it is approved as working inside uvcdat-next

Hope this helps.

doutriaux1 · 2014-09-03T15:50:50Z

thx @remram44

doutriaux1 · 2014-09-03T21:36:42Z

duplicate #595

doutriaux1 · 2014-09-03T21:37:15Z

that one appeared and disappeared magically for Jim and I. Going back and forth in commits seems to magically fix it....

doutriaux1 added bug labels Sep 3, 2014

doutriaux1 added this to the 2.0.0 milestone Sep 3, 2014

doutriaux1 assigned remram44 Sep 3, 2014

doutriaux1 mentioned this issue Sep 3, 2014

cdms missing in build #595

Closed

aashish24 closed this as completed Sep 12, 2014

This issue was closed.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

vistrails module uvcdat_cdms missing #581

vistrails module uvcdat_cdms missing #581

doutriaux1 commented Aug 28, 2014

ThomasMaxwell commented Aug 28, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

remram44 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

remram44 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

vistrails module uvcdat_cdms missing #581

vistrails module uvcdat_cdms missing #581

Comments

doutriaux1 commented Aug 28, 2014

ThomasMaxwell commented Aug 28, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

remram44 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

aashish24 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

doutriaux1 commented Sep 2, 2014

remram44 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014

doutriaux1 commented Sep 3, 2014