[Python] 3.0 linux wheel not installing on Python 3.6

[asfimport]

When trying to install pyarrow 3.0.0 for Python 3.6 on Linux, it defaults to pulling down the source tarball and attempting to compile it rather than use either of the manylinux wheels. I've tested this using Python 3.6.2 and 3.6.12 on Fedora 33 x64 machine (however our CI exhibits the same issue) 

 

$ pyenv version
3.6.12 (set by /home/mandeep/.pyenv/version)
$ python --version
Python 3.6.12

$ pip3 install pyarrow
Collecting pyarrow
 Using cached https://files.pythonhosted.org/packages/62/d3/a482d8a4039bf931ed6388308f0cc0541d0cab46f0bbff7c897a74f1c576/pyarrow-3.0.0.tar.gz
 Installing build dependencies ... done
Collecting numpy>=1.16.6 (from pyarrow)
 Using cached https://files.pythonhosted.org/packages/45/b2/6c7545bb7a38754d63048c7696804a0d947328125d81bf12beaa692c3ae3/numpy-1.19.5-cp36-cp36m-manylinux1_x86_64.whl
Installing collected packages: numpy, pyarrow
 Running setup.py install for pyarrow ... error

 

I've added a link to our CI that exhibits the same problem and indicates that it only occurs on Python 3.6 on Linux (other Python versions and OSs are fine) - https://github.com/datapane/datapane/runs/1828066893?check_suite_focus=true#step:10:117 .

 

Environment: Linux x64
Reporter: Mandeep Gill

_{Note: This issue was originally created as ARROW-11498. Please see the migration documentation for further details.}

[asfimport]

Weston Pace / @westonpace:
I believe your pip version is too old.  Arrow is packaging the manylinux2010 and manylinux2014 tags which require Pip version 19.3 and 19.  The manylinux1 tag which you are using for the numpy install was added in pip version 8.1.2.  The pip installed on your CI system is version 9.

[asfimport]

Weston Pace / @westonpace:
Related: https://issues.apache.org/jira/browse/ARROW-5756

[asfimport]

Mandeep Gill:
Ah I see - can confirm upgrading pip in my 3.6 venv and reinstalling pyarrow worked as expected and pulled the manylinux2014 wheel.

Thank you for the pointer - perhaps worth updating the install docs re python 3.6 / pip compatibility - will see if I can contribute a PR. Closing this issue in the meantime.