Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set #9436

halflings · 2017-04-25T11:53:43Z

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): N/A
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Mac OS X Sierra
TensorFlow installed from (source or binary): N/A (compiling from HEAD)
TensorFlow version (use command below): N/A (see above)
Bazel version (if compiling from source): 0.4.5-homebrew
CUDA/cuDNN version: none (AMD GPU)
GPU model and memory: Radeon Pro 460
Exact command to reproduce:

sudo bazel build --config opt --copt=-msse4.1 --copt=-msse4.1 --copt=-mavx --copt=-mavx2 --copt=-mfma //tensorflow/tools/pip_package:build_pip_package

Describe the problem

Trying to build tensorflow from source (version installed via pip does not use some optimised CPU instructions), get the following error:

 ~/workspace/tensorflow   master  sudo bazel build --config opt --copt=-msse4.1 --copt=-msse4.1 --copt=-mavx --copt=-mavx2 --copt=-mfma //tensorflow/tools/pip_package:build_pip_package
WARNING: Config values are not defined in any .rc file: opt
ERROR: /Users/kachkach/workspace/tensorflow/third_party/py/numpy/BUILD:11:1: no such package '@local_config_python//': Traceback (most recent call last):
	File "/Users/kachkach/workspace/tensorflow/third_party/py/python_configure.bzl", line 180
		_create_python_repository(repository_ctx)
	File "/Users/kachkach/workspace/tensorflow/third_party/py/python_configure.bzl", line 157, in _create_python_repository
		_get_env_var(repository_ctx, _PYTHON_BIN_PATH)
	File "/Users/kachkach/workspace/tensorflow/third_party/py/python_configure.bzl", line 48, in _get_env_var
		_python_configure_fail("'%s' environment variable is no...)
	File "/Users/kachkach/workspace/tensorflow/third_party/py/python_configure.bzl", line 36, in _python_configure_fail
		fail("
%sPython Configuration Error:%...))

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set
 and referenced by '//third_party/py/numpy:headers'.
ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted.

Note that I used which python3 to find where my Python binary is located, and exported that as PYTHON_BIN_PATH, but it does not seem to help.

The text was updated successfully, but these errors were encountered:

halflings · 2017-04-25T11:54:28Z

Also (unrelated), the tools/tf_env_collect.sh script does not work::

bash tools/tf_env_collect.sh
Collecting system information...
cat: /proc/1/cgroup: No such file or directory
tools/tf_env_collect.sh: line 31: syntax error near unexpected token `>'
tools/tf_env_collect.sh: line 31: `c++ --version &>> $OUTPUT_FILE'

girving · 2017-04-25T16:02:10Z

Did you run configure?

haiy · 2017-04-26T10:53:41Z

@girving I had the same error when I'm build tensorflow-serving.And I've configured the tensorflow alreay.

girving · 2017-04-26T14:15:55Z

@caisq Is tf_env_collect supposed to work on Mac? It appears Linux only since it has an unguarded reference to /proc.

caisq · 2017-04-26T14:35:14Z

cc @aselle (author) for whether tf_env_collect.sh is supposed to work on Mac.

harshthaker · 2017-04-26T14:40:54Z

I am getting the same error trying to run command 'bazel build --config opt tensorflow/examples/image_retraining:retrain' Error: 'PYTHON_BIN_PATH' environment variable is not set and referenced by '//util/python:python_headers'.

hantingxie · 2017-04-26T15:37:34Z

I think this is a recent problem with the current master's source codes. I tested the compilation of Tensorflow serving both locally and in docker. Both environments gave me the same error "Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set". Of course, I set the configure before the build. In fact, I was able to successfully compile Tensorflow under the same environment with the same configuration a few weeks ago and there was no problem. So this must be a recent issue.

The full error message is:
`ERROR: /root/.cache/bazel/_bazel_root/f8d1071c69ea316497c31e40fe01608c/external/org_tensorflow/util/python/BUILD:5:1: no such package '@local_config_python//': Traceback (most recent call last):
File "/root/.cache/bazel/_bazel_root/f8d1071c69ea316497c31e40fe01608c/external/org_tensorflow/third_party/py/python_configure.bzl", line 180
_create_python_repository(repository_ctx)
File "/root/.cache/bazel/_bazel_root/f8d1071c69ea316497c31e40fe01608c/external/org_tensorflow/third_party/py/python_configure.bzl", line 157, in _create_python_repository
_get_env_var(repository_ctx, _PYTHON_BIN_PATH)
File "/root/.cache/bazel/_bazel_root/f8d1071c69ea316497c31e40fe01608c/external/org_tensorflow/third_party/py/python_configure.bzl", line 48, in _get_env_var
_python_configure_fail("'%s' environment variable is no...)
File "/root/.cache/bazel/_bazel_root/f8d1071c69ea316497c31e40fe01608c/external/org_tensorflow/third_party/py/python_configure.bzl", line 36, in _python_configure_fail
fail("
%sPython Configuration Error:%...))

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set`

girving · 2017-04-26T15:53:35Z

@jart Do you know what the issue might be?

neocortical · 2017-04-26T21:59:19Z

I just ran into this issue as well. I am compiling in an Ubuntu 14.04 Docker container (using the standard Dockerfile.devel image).

hantingxie · 2017-04-27T10:28:40Z

Just want to make people aware of that you don't need to wait for this to be solved if you don't necessarily need to work with the latest RC version. I have just tested it with Tensorflow serving, and it works with its latest release (tag 0.5.1). You can simply clone that tag by running.
git clone -b 0.5.1 --recurse-submodules https://github.com/tensorflow/serving
For anyone who are using Tensorflow itself, you could do similar things such as:
git clone -b v1.1.0 https://github.com/tensorflow/tensorflow
I haven't tested it for Tensorflow, if it still doesn't work, you could switch to any earlier release which is over here.

neocortical · 2017-04-27T17:52:24Z

Adding to @shadowfury330's point, if you have TF Serving source checked out at master already, you can switch to the latest release by running:

git checkout 0.5.1
git submodule update

You should then be able to run bazel successfully.

halflings · 2017-04-27T18:30:18Z

@girving : Turns out I forgot to run configure on this instance (it was freshly cloned from HEAD), that fixed it for me but I'm leaving this open as some people seem to be having this problem even after running configure.

hantingxie · 2017-05-08T10:04:41Z

~~I think I finally found out the problem that caused my issue. So the problem is Anaconda~~. Thanks to @MtDersvan and @Shoshin23 , It seems that the problem doesn't only apply to Anaconda. But no matter what caused it, the problem seems to be that the building system did not set the path variable PYTHON_BIN_PATH correctly via the ".configure" file even though it seems to detect your path without any problem.

In order to solve it, you could simply try to export the variable it needed before the build with:
export PYTHON_BIN_PATH = /home/ubuntu/anaconda3/bin/python or wherever your python binary is placed.
Hopefully, it can help some of you guys.

MtDersvan · 2017-05-08T10:57:18Z

@hantingxie I have the same problem, but I'm building tensorflow-serving using standard Dockerfile.devel image as @neocortical did. So it might not be specifically only Anaconda related problem. Also, it worked for me just couple weeks before with the same configuration.

hantingxie · 2017-05-08T11:03:21Z

@MtDersvan Good to hear that you solved it. I agree with you, this issue might be caused by several different reasons. Anaconda can be one of them.

Shoshin23 · 2017-05-08T13:29:44Z

Hi, it seems to be working fine for me with @hantingxie 's solution. For some reason desipte ./configure recognizing my default path I still had to manually set my PYTHON_BIN_PATH. And yes, this is happening in the default dockerfile that's mentioned in the tensorflow serving docs.

jart · 2017-05-24T21:40:59Z

There's a possibility this is a bug upstream in Bazel. Maybe --action_env is not being passed along to repository_ctx properly.

jart · 2017-05-24T21:41:37Z

@nlopezgi should know about this issue.

Fixes tensorflow#9436

- Remove experimental attributes (local_checks, python_include, numpy_include, remote_config_repo). Use of experimental remote repo can only be enabled now via env variable (preferred to change to workspace file) - Fix hardcoded fallback value for python bin. New fallback is to use 'which python' and fail if python not set in path (solves tensorflow#9436 / works around bazelbuild/bazel#3057). - Fixes minor issues with template: adds spaces to srcs in genrule, remove extra space after genrules. - Some dead code clean up (use of empty configuration) PiperOrigin-RevId: 160594421

charlesjohannisen · 2017-09-06T19:27:15Z

For anyone who's still getting this error:
add --action_env=PYTHON_BIN_PATH=/usr/bin/python to ~/.bazelrc as per https://bazel.build/designs/2016/06/21/environment.html
If you're building from your own Dockerfile, adding ENV PYTHON_BIN_PATH=/usr/bin/python will be adequate.

RobRomijnders · 2017-11-23T10:04:18Z

Might be unrelated for many, but this is how I circumvented the error. I am installing in a virtual env.

I installed the virtualenv library in python3.5. Upon making the env, I point to the binaries for python3.6. This gives me the error.

Now I solved the problem as follows. I install virtualenv for python3.6 and use that to make an env. In this env, this above error does not occur.

sxp4u · 2017-12-05T02:34:57Z

I solve the same problem by adding the PYTHON_BIN_PATH to " ~/.bash_profile ".

If you don't have a Environment Parameter named PYTHON_BIN_PATH, the error msg will be ['PYTHON_BIN_PATH' environment variable is not set], if you already have one but not correct, the error msg would be [ PYTHON_BIN_PATH is not executable ].

Note that the PYTHON_BIN_PATH should specify to ".../bin/python" instead of ".../bin ", the latter would raise the [ not executable ] error.

nlopezgi · 2017-12-05T15:25:18Z

Since #14467 it is again required to have the env variable PYTHON_BIN_PATH explicitly set, run configure script to set it, or to set it via --action_env.

sxp4u · 2017-12-06T05:16:32Z

yeah, you are right. I'v found that later. If run configure, both problem I mentioned above should not happen. 2017-12-05 23:31 GMT+08:00 Nicolas Lopez <notifications@github.com>:

…

Since #14467 <#14467> it is again required to have the env variable PYTHON_BIN_PATH explicitly set, run configure script to set it, or to set it via --action_env. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#9436 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ASdZr8UEiLTohC88z7iyqVOrxAQYPADYks5s9WG7gaJpZM4NHX2y> .

mirwisek · 2021-06-26T14:39:16Z

I have the same issue, none of the above solution worked for me.

I'm getting the following error in Windows 10 x64:

C:/users/{user}/_bazel_{user}/sudrsvim/external/tf_toolchains/toolchains/remote_config/configs.bzl:6:28: in initialize_rbe_configs
  C:/users/{user}/_bazel_{user}/sudrsvim/external/tf_toolchains/toolchains/remote_config/rbe_config.bzl:158:27: in _tensorflow_local_config
Repository rule local_python_configure defined at:
  C:/users/{user}/_bazel_{user}/sudrsvim/external/org_tensorflow/third_party/py/python_configure.bzl:275:41: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_execution_config_python':
   Traceback (most recent call last):
        File "C:/users/{user}/_bazel_{user}/sudrsvim/external/org_tensorflow/third_party/py/python_configure.bzl", line 209, column 22, in _create_local_python_repository
                _check_python_bin(repository_ctx, python_bin)
        File "C:/users/{user}/_bazel_{user}/sudrsvim/external/org_tensorflow/third_party/py/python_configure.bzl", line 145, column 25, in _check_python_bin
                auto_config_fail("--define %s='%s' is not executable. Is it the python binary?" % (
        File "C:/users/{user}/_bazel_{user}/sudrsvim/external/org_tensorflow/third_party/remote_config/common.bzl", line 12, column 9, in auto_config_fail
                fail("%sConfiguration Error:%s %s\n" % (red, no_color, msg))
Error in fail: Configuration Error: --define PYTHON_BIN_PATH='C:\Users\{user}\AppData\Local\Microsoft\WindowsApps\python3.exe' is not executable. Is it the python binary?

I thought it must be an OS issue, I tried on Ubuntu 18.04 LTS (Windows Subsystem).

Then I got the same error with

ERROR: An error occurred during the fetch of repository 'local_execution_config_python':
   Traceback (most recent call last):
        File "/home/mirwisek/.cache/bazel/_bazel_mirwisek/da48a9b0cd92faf980f30b2a4925b53a/external/org_tensorflow/third_party/py/python_configure.bzl", line 212, column 41, in _create_local_python_repository
                python_include = _get_python_include(repository_ctx, python_bin)
        File "/home/mirwisek/.cache/bazel/_bazel_mirwisek/da48a9b0cd92faf980f30b2a4925b53a/external/org_tensorflow/third_party/py/python_configure.bzl", line 152, column 21, in _get_python_include
                result = execute(
        File "/home/mirwisek/.cache/bazel/_bazel_mirwisek/da48a9b0cd92faf980f30b2a4925b53a/external/org_tensorflow/third_party/remote_config/common.bzl", line 230, column 13, in execute
                fail(
Error in fail: Problem getting python include path.
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: cannot import name 'sysconfig'
Is the Python binary path set up right? (See ./configure or PYTHON_BIN_PATH.) Is distutils installed?

Yes, Python is installed correctly and I can use it with python3 on CMD as well as terminal. I tried to define the PYTHON_BIN_PATH in system variable to the location of python3, that didn't work.

charlesjohannisen · 2021-07-12T13:18:16Z

@mirwisek, or anyone else on this thread, which parts of tensorflow do you intend to use? There might be a docker container available for your use case. My original interest in tensorflow was syntaxnet, for which I found and subsequently forked a more user friendly version of the syntaxnet container. Point is, the containers are much more reliable than building and running the source.

- Remove experimental attributes (local_checks, python_include, numpy_include, remote_config_repo). Use of experimental remote repo can only be enabled now via env variable (preferred to change to workspace file) - Fix hardcoded fallback value for python bin. New fallback is to use 'which python' and fail if python not set in path (solves tensorflow/tensorflow#9436 / works around bazelbuild/bazel#3057). - Fixes minor issues with template: adds spaces to srcs in genrule, remove extra space after genrules. - Some dead code clean up (use of empty configuration) PiperOrigin-RevId: 160594421

girving added stat:awaiting response Status - Awaiting response from author type:build/install Build and install issues labels Apr 25, 2017

girving added stat:awaiting response Status - Awaiting response from author stat:awaiting tensorflower Status - Awaiting response from tensorflower and removed stat:awaiting response Status - Awaiting response from author labels Apr 26, 2017

girving closed this as completed Apr 27, 2017

girving reopened this Apr 27, 2017

MtDersvan mentioned this issue May 9, 2017

Exporting contrib.learn models for tensorflow_serving tensorflow/serving#228

Closed

jart removed the stat:awaiting tensorflower Status - Awaiting response from tensorflower label May 24, 2017

jart self-assigned this May 24, 2017

jart added a commit to jart/tensorflow that referenced this issue May 24, 2017

Make PYTHON_BIN_PATH error go away

30036d2

Fixes tensorflow#9436

jart mentioned this issue May 24, 2017

Make PYTHON_BIN_PATH error go away #10176

Merged

jart mentioned this issue May 26, 2017

--action_env not passing env to repository_ctx bazelbuild/bazel#3057

Closed

jart added a commit to jart/tensorflow that referenced this issue May 26, 2017

Make PYTHON_BIN_PATH error go away

a447f85

Fixes tensorflow#9436

maciekcc closed this as completed in #10176 May 26, 2017

shreyneil mentioned this issue Jul 19, 2017

Unable to optimise the graph #11618

Closed

mohantym mentioned this issue Jun 10, 2022

Configuration Error: --define PYTHON_BIN_PATH='C:/Users/user/AppData/Local/Programs/Python/Python39/python.exe' is not executable. Is it the python binary? #56420

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set #9436

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set #9436

halflings commented Apr 25, 2017 •

edited

Loading

halflings commented Apr 25, 2017

girving commented Apr 25, 2017

haiy commented Apr 26, 2017

girving commented Apr 26, 2017

caisq commented Apr 26, 2017

harshthaker commented Apr 26, 2017

hantingxie commented Apr 26, 2017

girving commented Apr 26, 2017

neocortical commented Apr 26, 2017

hantingxie commented Apr 27, 2017

neocortical commented Apr 27, 2017

halflings commented Apr 27, 2017

hantingxie commented May 8, 2017 •

edited

Loading

MtDersvan commented May 8, 2017

hantingxie commented May 8, 2017

Shoshin23 commented May 8, 2017

jart commented May 24, 2017

jart commented May 24, 2017

charlesjohannisen commented Sep 6, 2017

RobRomijnders commented Nov 23, 2017

sxp4u commented Dec 5, 2017

nlopezgi commented Dec 5, 2017

sxp4u commented Dec 6, 2017 via email

mirwisek commented Jun 26, 2021

charlesjohannisen commented Jul 12, 2021

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set #9436

Python Configuration Error: 'PYTHON_BIN_PATH' environment variable is not set #9436

Comments

halflings commented Apr 25, 2017 • edited Loading

System information

Describe the problem

halflings commented Apr 25, 2017

girving commented Apr 25, 2017

haiy commented Apr 26, 2017

girving commented Apr 26, 2017

caisq commented Apr 26, 2017

harshthaker commented Apr 26, 2017

hantingxie commented Apr 26, 2017

girving commented Apr 26, 2017

neocortical commented Apr 26, 2017

hantingxie commented Apr 27, 2017

neocortical commented Apr 27, 2017

halflings commented Apr 27, 2017

hantingxie commented May 8, 2017 • edited Loading

MtDersvan commented May 8, 2017

hantingxie commented May 8, 2017

Shoshin23 commented May 8, 2017

jart commented May 24, 2017

jart commented May 24, 2017

charlesjohannisen commented Sep 6, 2017

RobRomijnders commented Nov 23, 2017

sxp4u commented Dec 5, 2017

nlopezgi commented Dec 5, 2017

sxp4u commented Dec 6, 2017 via email

mirwisek commented Jun 26, 2021

charlesjohannisen commented Jul 12, 2021

halflings commented Apr 25, 2017 •

edited

Loading

hantingxie commented May 8, 2017 •

edited

Loading