Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Nightly integration test FAILED : ImportError: undefined symbol: _ZN6snappy11RawCompressEPKcmPcPm #611

Open
NvTimLiu opened this issue Apr 9, 2024 · 1 comment

Comments

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Apr 9, 2024

Nightly integration test FAILED : ImportError: /root/miniconda3/lib/python3.9/site-packages/pyarrow/../../.././liborc.so: undefined symbol: _ZN6snappy11RawCompressEPKcmPcPm

 =================================== FAILURES ===================================
 ___________________________ test_make_blobs[float32] ___________________________
 
     def require_minimum_pyarrow_version() -> None:
         """Raise ImportError if minimum version of pyarrow is not installed"""
         # TODO(HyukjinKwon): Relocate and deduplicate the version specification.
         minimum_pyarrow_version = "1.0.0"
     
         from distutils.version import LooseVersion
         import os
     
         try:
 >           import pyarrow
 
 /root/miniconda3/lib/python3.9/site-packages/pyspark/sql/pandas/utils.py:53: 
 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
 
     """
     PyArrow is the python implementation of Apache Arrow.
     
     Apache Arrow is a cross-language development platform for in-memory data.
     It specifies a standardized language-independent columnar memory format for
     flat and hierarchical data, organized for efficient analytic operations on
     modern hardware. It also provides computational libraries and zero-copy
     streaming messaging and interprocess communication.
     
     For more information see the official page at https://arrow.apache.org
     """
     
     import gc as _gc
     import importlib as _importlib
     import os as _os
     import platform as _platform
     import sys as _sys
     import warnings as _warnings
     
     try:
         from ._generated_version import version as __version__
     except ImportError:
         # Package is not installed, parse git tag at runtime
         try:
             import setuptools_scm
             # Code duplicated from setup.py to avoid a dependency on each other
     
             def parse_git(root, **kwargs):
                 """
                 Parse function for setuptools_scm that ignores tags for non-C++
                 subprojects, e.g. apache-arrow-js-XXX tags.
                 """
                 from setuptools_scm.git import parse
                 kwargs['describe_command'] = \
                     "git describe --dirty --tags --long --match 'apache-arrow-[0-9]*.*'"
                 return parse(root, **kwargs)
             __version__ = setuptools_scm.get_version('../',
                                                      parse=parse_git)
         except ImportError:
             __version__ = None
     
     # ARROW-8684: Disable GC while initializing Cython extension module,
     # to workaround Cython bug in https://github.com/cython/cython/issues/3603
     _gc_enabled = _gc.isenabled()
     _gc.disable()
 >   import pyarrow.lib as _lib
 E   ImportError: /root/miniconda3/lib/python3.9/site-packages/pyarrow/../../.././liborc.so: undefined symbol: _ZN6snappy11RawCompressEPKcmPcPm
 
 /root/miniconda3/lib/python3.9/site-packages/pyarrow/__init__.py:65: ImportError
@eordentlich
Copy link
Collaborator

Latest nightly passed without any changes. This looked to be a transient failure due to some issue in setting up the conda environment and the arrow dependency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants