[CI][Python] Building GCS with conda fails due to python 3.11

[asfimport]

Some of our jobs are failing with the following error:

 #9 436.0       /opt/conda/envs/arrow/bin/x86_64-conda-linux-gnu-cc -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/arrow/include -fPIC -O2 -isystem /opt/conda/envs/arrow/include -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /opt/conda/envs/arrow/include -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /opt/conda/envs/arrow/include -fPIC -D_WIN32_WINNT=1536 -DGRPC_XDS_USER_AGENT_NAME_SUFFIX=\"Python\" -DGRPC_XDS_USER_AGENT_VERSION_SUFFIX=\"1.46.1\" -DGPR_BACKWARDS_COMPATIBILITY_MODE=1 -DHAVE_CONFIG_H=1 -DGRPC_ENABLE_FORK_SUPPORT=1 "-DPyMODINIT_FUNC=extern \"C\" __attribute__((visibility (\"default\"))) PyObject*" -DGRPC_POSIX_FORK_ALLOW_PTHREAD_ATFORK=1 -Isrc/python/grpcio -Iinclude -I. -Ithird_party/abseil-cpp -Ithird_party/address_sorting/include -Ithird_party/cares/cares/include -Ithird_party/cares -Ithird_party/cares/cares -Ithird_party/cares/config_linux -Ithird_party/re2 -Ithird_party/boringssl-with-bazel/src/include -Ithird_party/upb -Isrc/core/ext/upb-generated -Isrc/core/ext/upbdefs-generated -Ithird_party/xxhash -Ithird_party/zlib -I/opt/conda/envs/arrow/include/python3.11 -c third_party/abseil-cpp/absl/synchronization/mutex.cc -o python_build/temp.linux-x86_64-cpython-311/third_party/abseil-cpp/absl/synchronization/mutex.o -std=c++11 -std=gnu99 -fvisibility=hidden -fno-wrapv -fno-exceptions -pthread
#9 436.0       cc1plus: warning: command-line option '-std=gnu99' is valid for C/ObjC but not for C++
#9 436.0       /opt/conda/envs/arrow/bin/x86_64-conda-linux-gnu-cc -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/arrow/include -fPIC -O2 -isystem /opt/conda/envs/arrow/include -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /opt/conda/envs/arrow/include -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /o
#9 436.0 [output clipped, log limit 1MiB reached]
#9 436.0   Running setup.py clean for grpcio
#9 436.5   Building wheel for MarkupSafe (setup.py): started
#9 437.1   Building wheel for MarkupSafe (setup.py): finished with status 'done'
#9 437.1   Created wheel for MarkupSafe: filename=MarkupSafe-2.1.1-cp311-cp311-linux_x86_64.whl size=14671 sha256=67c65c45044f53d1023ff7487966de358f31f3366464fb49b49526cfc1afee21
#9 437.1   Stored in directory: /root/.cache/pip/wheels/96/ee/62/407c247ad088bcb67b530ba3ac1479058c58a651bd6bf09a1f
#9 437.1 Successfully built googleapis-storage-testbench crc32c MarkupSafe
#9 437.1 Failed to build grpcio
#9 437.2 Installing collected packages: crc32c, urllib3, six, scalpl, protobuf, MarkupSafe, itsdangerous, idna, gunicorn, click, charset-normalizer, certifi, Werkzeug, requests, Jinja2, grpcio, googleapis-common-protos, requests-toolbelt, flask, googleapis-storage-testbench
#9 438.0   Running setup.py install for grpcio: started
#9 498.2   Running setup.py install for grpcio: still running...
#9 558.2   Running setup.py install for grpcio: still running...
#9 618.4   Running setup.py install for grpcio: still running...
#9 679.0   Running setup.py install for grpcio: still running...
#9 739.3   Running setup.py install for grpcio: still running...
#9 799.6   Running setup.py install for grpcio: still running...
#9 859.6   Running setup.py install for grpcio: still running...
#9 901.6   Running setup.py install for grpcio: finished with status 'error'
#9 ERROR: executor failed running [/bin/bash -c -l /arrow/ci/scripts/install_gcs_testbench.sh default]: exit code: 1

this seems to be due to the command:

RUN mamba install -q -y --file arrow/ci/conda_env_cpp.txt --file arrow/ci/conda_env_gandiva.txt compilers doxygen valgrind && mamba clean --all 

installing the latest Python 3.11:

17.78 + python 3.11.0 h582c2e5_0_cpython conda-forge/linux-64 38MB 

Example of job failure: https://github.com/apache/arrow/actions/runs/3319519611/jobs/5484773342

Reporter: Raúl Cumplido / @raulcd
Assignee: Raúl Cumplido / @raulcd

PRs and other links:

• GitHub Pull Request #14500

_{Note: This issue was originally created as ARROW-18158. Please see the migration documentation for further details.}

[asfimport]

Joris Van den Bossche / @jorisvandenbossche:
Issue resolved by pull request 14500
#14500