Python bindings build accesses internet: Failed to establish a new connection: [Errno 8] Name does not resolve')': /simple/ortools/

[yurivict]

What version of OR-tools and what language are you using?
Version: 8.1
Language: Python

What operating system (Linux, Windows, ...) and version?
FreeBSD 12.2

It builds with internet connection, but fails without it:

[414/414] cd /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1 && /usr/local/bin/python3.7 -m venv /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv && /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/bin/python -m pip install --find-links=/wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist ortools && /usr/local/bin/cmake -E copy /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/test.py.in /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/test.py
FAILED: CMakeFiles/python_package.util python/venv
cd /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1 && /usr/local/bin/python3.7 -m venv /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv && /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/bin/python -m pip install --find-links=/wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist ortools && /usr/local/bin/cmake -E copy /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/test.py.in /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/test.py
Looking in links: /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x802fa2b10>: Failed to establish a new connection: [Errno 8] Name does not resolve')': /simple/ortools/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x802fc4810>: Failed to establish a new connection: [Errno 8] Name does not resolve')': /simple/ortools/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x802ff0350>: Failed to establish a new connection: [Errno 8] Name does not resolve')': /simple/ortools/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x802ff0510>: Failed to establish a new connection: [Errno 8] Name does not resolve')': /simple/ortools/

[Mizux]

My guess is python/venv/bin/python -m pip install --find-links=/wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist ortools still check pypi.org 🤔

@yurivict could you try to run by hand each part of the command to be sure which one is responsible for the issue, i.e.

cd /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1
/usr/local/bin/python3.7 -m venv /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv
/wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/bin/python -m pip install --find-links=/wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist ortools
/usr/local/bin/cmake -E copy /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/test.py.in /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/test.py

[yurivict]

[yuri@yv /usr/ports/math/py-or-tools/work-py37/or-tools-8.1]$ /usr/local/bin/python3.7 -m venv /wrkdirs/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv
Error: [Errno 13] Permission denied: '/wrkdirs'
[yuri@yv /usr/ports/math/py-or-tools/work-py37/or-tools-8.1]$ /usr/local/bin/python3.7 -m venv /usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv

[yuri@yv /usr/ports/math/py-or-tools/work-py37/or-tools-8.1]$ 
[yuri@yv /usr/ports/math/py-or-tools/work-py37/or-tools-8.1]$ /usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/bin/python -m pip install --find-links=/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist ortools
Looking in links: /usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist
WARNING: Url '/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist' is ignored. It is either a non-existing path or lacks a specific scheme.
ERROR: Could not find a version that satisfies the requirement ortools (from versions: none)
ERROR: No matching distribution found for ortools
WARNING: Url '/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/dist' is ignored. It is either a non-existing path or lacks a specific scheme.
WARNING: You are using pip version 20.1.1; however, version 20.3.3 is available.
You should consider upgrading via the '/usr/ports/math/py-or-tools/work-py37/or-tools-8.1/python/venv/bin/python -m pip install --upgrade pip' command.

[yurivict]

Version 7.7 didn't have such problem.

[Mizux]

strange, maybe add a --no-index here:

or-tools/cmake/python.cmake

Line 209 in 687bdd6

COMMAND ${VENV_Python_EXECUTABLE} -m pip install --find-links=${CMAKE_CURRENT_BINARY_DIR}/python/dist ${PROJECT_NAME}

ref: https://pip.pypa.io/en/latest/reference/pip_install/#cmdoption-no-index

[yurivict]

Now it fails to find the package:

ERROR: Could not find a version that satisfies the requirement absl-py>=0.11 (from ortools) (from versions: none)
ERROR: No matching distribution found for absl-py>=0.11 (from ortools)

despite it being installed:

$ pkg info | grep absl-py
py37-absl-py-0.11.0            Abseil Python Common Libraries

[yurivict]

I have to apply this patch to make it build w/out internet access:

--- ortools/python/setup.py.in.orig	2020-12-30 17:40:00 UTC
+++ ortools/python/setup.py.in
@@ -42,8 +42,8 @@ setup(
     version='@PROJECT_VERSION@',
     packages=find_packages(),
     install_requires=[
-        'protobuf >= 3.14.0',
-        'absl-py >= 0.11',
+        #'protobuf >= 3.14.0',
+        #'absl-py >= 0.11',
     ],
     package_data={
         '@PROJECT_NAME@':[$<$<NOT:$<PLATFORM_ID:Windows>>:'.libs/*', '../$<TARGET_SONAME_FILE_NAME:ortools>'>],
--- tools/setup.py.in.orig	2020-12-09 16:30:21 UTC
+++ tools/setup.py.in
@@ -42,8 +42,8 @@ setup(
     version='VVVV',
     packages=find_packages(),
     install_requires=[
-        'protobuf >= 3.14.0',
-        'absl-py >= 0.11',
+        #'protobuf >= 3.14.0',
+        #'absl-py >= 0.11',
     ],
     package_data={
         'ortools.constraint_solver' : ['_pywrapcp.dll', '*.pyi'],

It was the same way before 8.1, so this isn't a regression.

[Mizux]

Building without internet access is not (won't be) a goal.
I'm happy you find a way to hack it !