Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] Arrow 0.10 on Python 3.7 install failure on Ubuntu 17.10 #19769

Closed
asfimport opened this issue Oct 5, 2018 · 4 comments
Closed

[Python] Arrow 0.10 on Python 3.7 install failure on Ubuntu 17.10 #19769

asfimport opened this issue Oct 5, 2018 · 4 comments

Comments

@asfimport
Copy link

I ran into an issue on Travis around building pyarrow on python 3.7 and was able to reproduce it on my local machine. It seems like the manylinux builds for other versions of python don't require cython and install without issue. But python 3.7 throws fits. I followed installation instructions on https://arrow.apache.org/install/ to install the C++ and GLib bindings just in case, but no luck. I also followed up on a variety of earlier issue threads but most either claim this is fixed now or never resolved the user issues.

Any suggestions on if this is a pyarrow or environment issue? Here's the command output from a fresh 3.7 virtualenv, post arrow C++ install and with Cython included.

I ran into an issue on Travis around building pyarrow on python 3.7 and was able to reproduce it on my local machine. It seems like the manylinux builds for other versions of python don't require cython and install without issue. But python 3.7 throws fits. I followed installation instructions on https://arrow.apache.org/install/ to install the C++ and GLib bindings just in case, but no luck. I also followed up on a variety of earlier issue threads but most either claim this is fixed now or never resolved the user issues.

Any suggestions on if this is a pyarrow or environment issue? Here's the command output from a fresh 3.7 virtualenv, post arrow C++ install and with Cython included.

10:44:32 mseal ~/Workspace (venv:.py37local)  
$ pip install pyarrow
Looking in indexes: https://smartiproxy.mgmt.netflix.net/pypi
Collecting pyarrow
  Using cached https://smartiproxy.mgmt.netflix.net/pypi/packages/pypi-public/pyarrow/pyarrow-0.10.0.tar.gz
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-4nqipach/pyarrow/setup.py", line 29, in <module>
        from Cython.Distutils import build_ext as _build_ext
    ModuleNotFoundError: No module named 'Cython'
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-4nqipach/pyarrow/
10:44:42 mseal ~/Workspace (venv:.py37local)  
$ pip install cython
Looking in indexes: https://smartiproxy.mgmt.netflix.net/pypi
Collecting cython
  Using cached https://smartiproxy.mgmt.netflix.net/pypi/packages/pypi-public/cython/Cython-0.28.5-cp37-cp37m-manylinux1_x86_64.whl
Installing collected packages: cython
Successfully installed cython-0.28.5
10:44:48 mseal ~/Workspace (venv:.py37local)  
$ pip install pyarrow
Looking in indexes: https://smartiproxy.mgmt.netflix.net/pypi
Collecting pyarrow
  Using cached https://smartiproxy.mgmt.netflix.net/pypi/packages/pypi-public/pyarrow/pyarrow-0.10.0.tar.gz
Requirement already satisfied: numpy>=1.10 in /home/mseal/.py37local/lib/python3.7/site-packages (from pyarrow) (1.15.0)
Requirement already satisfied: six>=1.0.0 in /home/mseal/.py37local/lib/python3.7/site-packages (from pyarrow) (1.11.0)
Building wheels for collected packages: pyarrow
  Running setup.py bdist_wheel for pyarrow ... error
  Complete output from command /home/mseal/.py37local/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-egupyzqv/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/pip-wheel-tkbu2kaa --python-tag cp37:
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.7
  creating build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/compat.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/jvm.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/orc.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/feather.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/parquet.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/formatting.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/serialization.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/filesystem.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/benchmark.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/types.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/util.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/hdfs.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/plasma.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/ipc.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/pandas_compat.py -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/__init__.py -> build/lib.linux-x86_64-3.7/pyarrow
  creating build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_tensor.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_misc.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_hdfs.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/pandas_examples.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_convert_builtin.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/deserialize_buffer.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_array.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_feather.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_serialization.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_convert_pandas.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_table.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_types.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_plasma.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_jvm.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/conftest.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_builder.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_scalars.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/util.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_ipc.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_cython.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_io.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_deprecations.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_parquet.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/test_schema.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  copying pyarrow/tests/__init__.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
  running egg_info
  writing pyarrow.egg-info/PKG-INFO
  writing dependency_links to pyarrow.egg-info/dependency_links.txt
  writing entry points to pyarrow.egg-info/entry_points.txt
  writing requirements to pyarrow.egg-info/requires.txt
  writing top-level names to pyarrow.egg-info/top_level.txt
  reading manifest file 'pyarrow.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no previously-included files matching '*.so' found anywhere in distribution
  warning: no previously-included files matching '*.pyc' found anywhere in distribution
  warning: no previously-included files matching '*~' found anywhere in distribution
  warning: no previously-included files matching '#*' found anywhere in distribution
  warning: no previously-included files matching '.git*' found anywhere in distribution
  warning: no previously-included files matching '.DS_Store' found anywhere in distribution
  writing manifest file 'pyarrow.egg-info/SOURCES.txt'
  copying pyarrow/__init__.pxd -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_orc.cpp -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_orc.pxd -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_orc.pyx -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_parquet.cpp -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_parquet.pxd -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_parquet.pyx -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_plasma.cpp -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/_plasma.pyx -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/array.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/benchmark.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/builder.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/error.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/feather.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/io-hdfs.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/io.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/ipc.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/lib.cpp -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/lib.pxd -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/lib.pyx -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/lib_api.h -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/memory.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/plasma_store -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/public-api.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/scalar.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/serialization.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/table.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  copying pyarrow/types.pxi -> build/lib.linux-x86_64-3.7/pyarrow
  creating build/lib.linux-x86_64-3.7/pyarrow/include
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/allocator.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/array.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/buffer.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/builder.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/compare.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/memory_pool.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/pretty_print.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/record_batch.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/status.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/stl.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/table.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/table_builder.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/tensor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/test-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/type.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/type_fwd.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  copying pyarrow/include/arrow/visitor_inline.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/orc
  copying pyarrow/include/arrow/adapters/orc/adapter.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/orc
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/tensorflow
  copying pyarrow/include/arrow/adapters/tensorflow/convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/tensorflow
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
  copying pyarrow/include/arrow/compute/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
  copying pyarrow/include/arrow/compute/context.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
  copying pyarrow/include/arrow/compute/kernel.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
  copying pyarrow/include/arrow/compute/kernels/cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
  copying pyarrow/include/arrow/compute/kernels/hash.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/buffered.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/file.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/hdfs.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/interfaces.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  copying pyarrow/include/arrow/io/memory.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/dictionary.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/feather.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/json.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/message.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/reader.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  copying pyarrow/include/arrow/ipc/writer.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/arrow_to_pandas.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/arrow_to_python.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/benchmark.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/builtin_convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/common.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/config.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/decimal.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/helpers.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/init.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/iterators.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/numpy_convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/numpy_interop.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/numpy_to_arrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/platform.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/pyarrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/python_to_arrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  copying pyarrow/include/arrow/python/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/bit-stream-utils.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/bit-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/bpacking.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/checked_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compiler-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression_brotli.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression_lz4.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression_snappy.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression_zlib.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/compression_zstd.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/cpu-info.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/decimal.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/hash-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/hash.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/io-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/key_value_metadata.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/lazy.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/logging.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/macros.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/memory.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/optional.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/parallel.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/recursive_wrapper.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/rle-encoding.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/sse-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/stl.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/string.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/thread-pool.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/variant.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/variant_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/variant_io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/variant_visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  copying pyarrow/include/arrow/util/visibility.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
  creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  copying pyarrow/include/arrow/util/variant/optional.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  copying pyarrow/include/arrow/util/variant/recursive_wrapper.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  copying pyarrow/include/arrow/util/variant/variant_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  copying pyarrow/include/arrow/util/variant/variant_io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  copying pyarrow/include/arrow/util/variant/variant_visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
  creating build/lib.linux-x86_64-3.7/pyarrow/includes
  copying pyarrow/includes/__init__.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
  copying pyarrow/includes/common.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
  copying pyarrow/includes/libarrow.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
  creating build/lib.linux-x86_64-3.7/pyarrow/tensorflow
  copying pyarrow/tensorflow/build.sh -> build/lib.linux-x86_64-3.7/pyarrow/tensorflow
  copying pyarrow/tensorflow/plasma_op.cc -> build/lib.linux-x86_64-3.7/pyarrow/tensorflow
  copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.linux-x86_64-3.7/pyarrow/tests
  creating build/lib.linux-x86_64-3.7/pyarrow/tests/data
  copying pyarrow/tests/data/v0.7.1.all-named-index.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
  copying pyarrow/tests/data/v0.7.1.column-metadata-handling.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
  copying pyarrow/tests/data/v0.7.1.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
  copying pyarrow/tests/data/v0.7.1.some-named-index.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
  running build_ext
  creating build/temp.linux-x86_64-3.7
  -- Runnning cmake for pyarrow
  cmake -DPYTHON_EXECUTABLE=/home/mseal/.py37local/bin/python3.7  -DPYARROW_BOOST_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /tmp/pip-install-egupyzqv/pyarrow
  -- The C compiler identification is GNU 7.2.0
  -- The CXX compiler identification is GNU 7.2.0
  -- Check for working C compiler: /usr/bin/cc
  -- Check for working C compiler: /usr/bin/cc -- works
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Check for working CXX compiler: /usr/bin/c++
  -- Check for working CXX compiler: /usr/bin/c++ -- works
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  INFOCompiler command: /usr/bin/c++
  INFOCompiler version: Using built-in specs.
  COLLECT_GCC=/usr/bin/c++
  COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
  OFFLOAD_TARGET_NAMES=nvptx-none
  OFFLOAD_TARGET_DEFAULT=1
  Target: x86_64-linux-gnu
  Configured with: ../src/configure -v --with-pkgversion='Ubuntu 7.2.0-8ubuntu3.2' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
  Thread model: posix
  gcc version 7.2.0 (Ubuntu 7.2.0-8ubuntu3.2)
  
  INFOCompiler id: GNU
  Selected compiler gcc 7.2.0
  -- Performing Test CXX_SUPPORTS_SSE3
  -- Performing Test CXX_SUPPORTS_SSE3 - Success
  -- Performing Test CXX_SUPPORTS_ALTIVEC
  -- Performing Test CXX_SUPPORTS_ALTIVEC - Failed
  Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
  -- Build Type: RELEASE
  -- Build output directory: /tmp/pip-install-egupyzqv/pyarrow/build/temp.linux-x86_64-3.7/release
  -- Found PythonInterp: /home/mseal/.py37local/bin/python3.7 (found version "3.7")
  -- Searching for Python libs in /home/mseal/.py37local/lib64;/home/mseal/.py37local/lib;/usr/lib/python3.7/config-3.7m-x86_64-linux-gnu
  -- Looking for python3.7m
  -- Found Python lib /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
  -- Found PythonLibs: /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
  -- Found NumPy: version "1.15.0" /home/mseal/.py37local/lib/python3.7/site-packages/numpy/core/include
  -- Searching for Python libs in /home/mseal/.py37local/lib64;/home/mseal/.py37local/lib;/usr/lib/python3.7/config-3.7m-x86_64-linux-gnu
  -- Looking for python3.7m
  -- Found Python lib /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
  -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.1")
  -- Checking for module 'arrow'
  --   Found arrow, version 0.9.0
  -- Arrow SO and ABI version: 0
  -- Arrow full SO version:
  -- Found the Arrow core library: /usr/lib/x86_64-linux-gnu/libarrow.so
  -- Found the Arrow Python library: ARROW_PYTHON_LIB_PATH-NOTFOUND
  Added shared library dependency arrow: /usr/lib/x86_64-linux-gnu/libarrow.so
  Added shared library dependency arrow_python: /usr/lib/x86_64-linux-gnu/libarrow_python.so
  -- Configuring done
  -- Generating done
  -- Build files have been written to: /tmp/pip-install-egupyzqv/pyarrow/build/temp.linux-x86_64-3.7
  -- Finished cmake for pyarrow
  -- Running cmake --build for pyarrow
  cmake --build . --config release --
  Scanning dependencies of target lib_pyx
  [ 33%] Compiling Cython CXX source for lib...
  CMakeFiles/lib_pyx.dir/build.make:57: recipe for target 'CMakeFiles/lib_pyx' failed
  make[2]: *** [CMakeFiles/lib_pyx] Segmentation fault
  CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/lib_pyx.dir/all' failed
  make[1]: *** [CMakeFiles/lib_pyx.dir/all] Error 2
  Makefile:83: recipe for target 'all' failed
  make: *** [all] Error 2
  error: command 'cmake' failed with exit status 2
  
  ----------------------------------------
  Failed building wheel for pyarrow
  Running setup.py clean for pyarrow
Failed to build pyarrow
Installing collected packages: pyarrow
  Running setup.py install for pyarrow ... error
    Complete output from command /home/mseal/.py37local/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-egupyzqv/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-8k2toj2l/install-record.txt --single-version-externally-managed --compile --install-headers /home/mseal/.py37local/include/site/python3.7/pyarrow:
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.7
    creating build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/compat.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/jvm.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/orc.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/feather.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/parquet.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/formatting.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/serialization.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/filesystem.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/benchmark.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/types.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/util.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/hdfs.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/plasma.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/ipc.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/pandas_compat.py -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/__init__.py -> build/lib.linux-x86_64-3.7/pyarrow
    creating build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_tensor.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_misc.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_hdfs.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/pandas_examples.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_convert_builtin.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/deserialize_buffer.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_array.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_feather.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_serialization.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_convert_pandas.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_table.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_types.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_plasma.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_jvm.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/conftest.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_builder.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_scalars.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/util.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_ipc.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_cython.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_io.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_deprecations.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_parquet.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/test_schema.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    copying pyarrow/tests/__init__.py -> build/lib.linux-x86_64-3.7/pyarrow/tests
    running egg_info
    writing pyarrow.egg-info/PKG-INFO
    writing dependency_links to pyarrow.egg-info/dependency_links.txt
    writing entry points to pyarrow.egg-info/entry_points.txt
    writing requirements to pyarrow.egg-info/requires.txt
    writing top-level names to pyarrow.egg-info/top_level.txt
    reading manifest file 'pyarrow.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    warning: no previously-included files matching '*.so' found anywhere in distribution
    warning: no previously-included files matching '*.pyc' found anywhere in distribution
    warning: no previously-included files matching '*~' found anywhere in distribution
    warning: no previously-included files matching '#*' found anywhere in distribution
    warning: no previously-included files matching '.git*' found anywhere in distribution
    warning: no previously-included files matching '.DS_Store' found anywhere in distribution
    writing manifest file 'pyarrow.egg-info/SOURCES.txt'
    copying pyarrow/__init__.pxd -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_orc.cpp -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_orc.pxd -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_orc.pyx -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_parquet.cpp -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_parquet.pxd -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_parquet.pyx -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_plasma.cpp -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/_plasma.pyx -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/array.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/benchmark.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/builder.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/error.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/feather.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/io-hdfs.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/io.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/ipc.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/lib.cpp -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/lib.pxd -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/lib.pyx -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/lib_api.h -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/memory.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/plasma_store -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/public-api.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/scalar.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/serialization.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/table.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    copying pyarrow/types.pxi -> build/lib.linux-x86_64-3.7/pyarrow
    creating build/lib.linux-x86_64-3.7/pyarrow/include
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/allocator.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/array.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/buffer.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/builder.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/compare.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/memory_pool.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/pretty_print.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/record_batch.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/status.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/stl.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/table.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/table_builder.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/tensor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/test-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type_fwd.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    copying pyarrow/include/arrow/visitor_inline.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/orc
    copying pyarrow/include/arrow/adapters/orc/adapter.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/orc
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/tensorflow
    copying pyarrow/include/arrow/adapters/tensorflow/convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/adapters/tensorflow
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/context.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
    copying pyarrow/include/arrow/compute/kernel.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
    copying pyarrow/include/arrow/compute/kernels/cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
    copying pyarrow/include/arrow/compute/kernels/hash.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/compute/kernels
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/buffered.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/file.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/hdfs.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/interfaces.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    copying pyarrow/include/arrow/io/memory.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/io
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/dictionary.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/feather.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/json.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/message.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/reader.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    copying pyarrow/include/arrow/ipc/writer.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/ipc
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/api.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/arrow_to_pandas.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/arrow_to_python.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/benchmark.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/builtin_convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/common.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/config.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/decimal.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/helpers.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/init.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/iterators.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_convert.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_interop.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/numpy_to_arrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/platform.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/pyarrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/python_to_arrow.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    copying pyarrow/include/arrow/python/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/python
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bit-stream-utils.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bit-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/bpacking.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/checked_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compiler-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_brotli.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_lz4.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_snappy.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_zlib.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/compression_zstd.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/cpu-info.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/decimal.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/hash-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/hash.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/io-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/key_value_metadata.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/lazy.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/logging.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/macros.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/memory.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/optional.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/parallel.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/recursive_wrapper.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/rle-encoding.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/sse-util.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/stl.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/string.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/thread-pool.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/type_traits.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/variant_visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    copying pyarrow/include/arrow/util/visibility.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util
    creating build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/optional.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/recursive_wrapper.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_cast.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_io.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    copying pyarrow/include/arrow/util/variant/variant_visitor.h -> build/lib.linux-x86_64-3.7/pyarrow/include/arrow/util/variant
    creating build/lib.linux-x86_64-3.7/pyarrow/includes
    copying pyarrow/includes/__init__.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
    copying pyarrow/includes/common.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
    copying pyarrow/includes/libarrow.pxd -> build/lib.linux-x86_64-3.7/pyarrow/includes
    creating build/lib.linux-x86_64-3.7/pyarrow/tensorflow
    copying pyarrow/tensorflow/build.sh -> build/lib.linux-x86_64-3.7/pyarrow/tensorflow
    copying pyarrow/tensorflow/plasma_op.cc -> build/lib.linux-x86_64-3.7/pyarrow/tensorflow
    copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.linux-x86_64-3.7/pyarrow/tests
    creating build/lib.linux-x86_64-3.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.all-named-index.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.column-metadata-handling.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
    copying pyarrow/tests/data/v0.7.1.some-named-index.parquet -> build/lib.linux-x86_64-3.7/pyarrow/tests/data
    running build_ext
    creating build/temp.linux-x86_64-3.7
    -- Runnning cmake for pyarrow
    cmake -DPYTHON_EXECUTABLE=/home/mseal/.py37local/bin/python3.7  -DPYARROW_BOOST_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /tmp/pip-install-egupyzqv/pyarrow
    -- The C compiler identification is GNU 7.2.0
    -- The CXX compiler identification is GNU 7.2.0
    -- Check for working C compiler: /usr/bin/cc
    -- Check for working C compiler: /usr/bin/cc -- works
    -- Detecting C compiler ABI info
    -- Detecting C compiler ABI info - done
    -- Detecting C compile features
    -- Detecting C compile features - done
    -- Check for working CXX compiler: /usr/bin/c++
    -- Check for working CXX compiler: /usr/bin/c++ -- works
    -- Detecting CXX compiler ABI info
    -- Detecting CXX compiler ABI info - done
    -- Detecting CXX compile features
    -- Detecting CXX compile features - done
    INFOCompiler command: /usr/bin/c++
    INFOCompiler version: Using built-in specs.
    COLLECT_GCC=/usr/bin/c++
    COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
    OFFLOAD_TARGET_NAMES=nvptx-none
    OFFLOAD_TARGET_DEFAULT=1
    Target: x86_64-linux-gnu
    Configured with: ../src/configure -v --with-pkgversion='Ubuntu 7.2.0-8ubuntu3.2' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
    Thread model: posix
    gcc version 7.2.0 (Ubuntu 7.2.0-8ubuntu3.2)
    
    INFOCompiler id: GNU
    Selected compiler gcc 7.2.0
    -- Performing Test CXX_SUPPORTS_SSE3
    -- Performing Test CXX_SUPPORTS_SSE3 - Success
    -- Performing Test CXX_SUPPORTS_ALTIVEC
    -- Performing Test CXX_SUPPORTS_ALTIVEC - Failed
    Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
    -- Build Type: RELEASE
    -- Build output directory: /tmp/pip-install-egupyzqv/pyarrow/build/temp.linux-x86_64-3.7/release
    -- Found PythonInterp: /home/mseal/.py37local/bin/python3.7 (found version "3.7")
    -- Searching for Python libs in /home/mseal/.py37local/lib64;/home/mseal/.py37local/lib;/usr/lib/python3.7/config-3.7m-x86_64-linux-gnu
    -- Looking for python3.7m
    -- Found Python lib /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
    -- Found PythonLibs: /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
    -- Found NumPy: version "1.15.0" /home/mseal/.py37local/lib/python3.7/site-packages/numpy/core/include
    -- Searching for Python libs in /home/mseal/.py37local/lib64;/home/mseal/.py37local/lib;/usr/lib/python3.7/config-3.7m-x86_64-linux-gnu
    -- Looking for python3.7m
    -- Found Python lib /usr/lib/python3.7/config-3.7m-x86_64-linux-gnu/libpython3.7m.so
    -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.1")
    -- Checking for module 'arrow'
    --   Found arrow, version 0.9.0
    -- Arrow SO and ABI version: 0
    -- Arrow full SO version:
    -- Found the Arrow core library: /usr/lib/x86_64-linux-gnu/libarrow.so
    -- Found the Arrow Python library: ARROW_PYTHON_LIB_PATH-NOTFOUND
    Added shared library dependency arrow: /usr/lib/x86_64-linux-gnu/libarrow.so
    Added shared library dependency arrow_python: /usr/lib/x86_64-linux-gnu/libarrow_python.so
    -- Configuring done
    -- Generating done
    -- Build files have been written to: /tmp/pip-install-egupyzqv/pyarrow/build/temp.linux-x86_64-3.7
    -- Finished cmake for pyarrow
    -- Running cmake --build for pyarrow
    cmake --build . --config release --
    Scanning dependencies of target lib_pyx
    [ 33%] Compiling Cython CXX source for lib...
    CMakeFiles/lib_pyx.dir/build.make:57: recipe for target 'CMakeFiles/lib_pyx' failed
    make[2]: *** [CMakeFiles/lib_pyx] Segmentation fault
    CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/lib_pyx.dir/all' failed
    make[1]: *** [CMakeFiles/lib_pyx.dir/all] Error 2
    Makefile:83: recipe for target 'all' failed
    make: *** [all] Error 2
    error: command 'cmake' failed with exit status 2
    
    ----------------------------------------
Command "/home/mseal/.py37local/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-egupyzqv/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-8k2toj2l/install-record.txt --single-version-externally-managed --compile --install-headers /home/mseal/.py37local/include/site/python3.7/pyarrow" failed with error code 1 in /tmp/pip-install-egupyzqv/pyarrow/

Reporter: Matthew Seal

Note: This issue was originally created as ARROW-3447. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Matthew Seal:
It was suggested in #2708 that this is resolved in the upcoming 0.11 release

@asfimport
Copy link
Author

Antoine Pitrou / @pitrou:
I think this is simply because no binary wheel was produced for Python 3.7, so it's trying to compile from source, and you need Cython installed to compile from source (you probably need many other dependencies too, unless you already compiled Arrow C++ yourself, so we should really upload a Python 3.7 binary wheel to make your life easier).

cc'ing @wesm, @kou

@asfimport
Copy link
Author

Kouhei Sutou / @kou:
Missing Cython dependency should be fixed in Apache Arrow 0.11.0: #2508

 

We can't use deb packages for Python 3.7. Because deb packages are built for the system Python 3. You will be able to resolve ARROW_PYTHON_LIB_PATH-NOTFOUND by installing libarrow-python-dev package but it doesn't work because Python version difference.

 

So you need to build Apache Arrow from source with -DARROW_PYTHON=ON option.

 

Anyway, it's better that we provide wheels for Python 3.7. I've created a JIRA ticket for this: https://issues.apache.org/jira/browse/ARROW-3468

@asfimport
Copy link
Author

Matthew Seal:
Provided wheels are working now. Thank you for addressing the issue :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant