Build Pip Package Failed on Windows v1.8.0 with GPU #19103

yoshimur · 2018-05-05T04:18:15Z

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No!!
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow installed from (source or binary): Source
TensorFlow version (use command below): v1.8.0
Python version: 3.6
Bazel version (if compiling from source): CMake
GCC/Compiler version (if compiling from source): VS 2015
CUDA/cuDNN version: 9.1
GPU model and memory: GTX-1070 8GB
Exact command to reproduce:
git pull
git checkout refs/tags/v1.8.0
cd tensorflow\contrib\cmake
mkdir build
cd build
cmake .. -A x64 -DCMAKE_BUILD_TYPE=Release ^
-DSWIG_EXECUTABLE=C:\swigwin-3.0.12\swig.exe ^
-DPYTHON_EXECUTABLE=C:\Anaconda3\python.exe ^
-DPYTHON_LIBRARIES=C:\Anaconda3\libs\python36.lib ^
-Dtensorflow_ENABLE_GPU=ON ^
-DCUDNN_HOME="%CUDA_PATH%" ^
-Dtensorflow_CUDA_VERSION=9.1 ^
-Dtensorflow_WIN_CPU_SIMD_OPTIONS=/arch:AVX2

MSBuild /p:Configuration=Release tf_tutorials_example_trainer.vcxproj

MSBuild /p:Configuration=Release tf_python_build_pip_package.vcxproj

After this command, following error was occured. Sorry, this is Japanese System message.
But, problem is seems missing the "tensorflow/python/framework/cpp_shape_inference.pb.h"

"C:\repo\tensorflow\tensorflow\contrib\cmake\build\tf_python_build_pip_package.
vcxproj" (既定のターゲット) (1) ->
"C:\repo\tensorflow\tensorflow\contrib\cmake\build\pywrap_tensorflow_internal.v
cxproj" (既定のターゲット) (2) ->
"C:\repo\tensorflow\tensorflow\contrib\cmake\build\pywrap_tensorflow_internal_s
tatic.vcxproj" (既定のターゲット) (3) ->
"C:\repo\tensorflow\tensorflow\contrib\cmake\build\tf_c_python_api.vcxproj" (既定
のターゲット) (134) ->
(ClCompile ターゲット) ->
C:\repo\tensorflow\tensorflow\c\python_api.cc(19): fatal error C1083: include
ファイルを開けません。'tensorflow/python/framework/cpp_shape_inference.pb.h':No such file
or directory [C:\repo\tensorflow\tensorflow\contrib\cmake\build\tf_c_python_ap
i.vcxproj]

90 個の警告 (Note: 90's Warning)
1 エラー (Note: Error)

Best regards.

The text was updated successfully, but these errors were encountered:

darindf · 2018-05-07T22:00:11Z

I have similar issue as well, except my errors are in english

"C:\Users\user\Documents\tensorflow\tensorflow\contrib\cmake\buildr1.8\tf_python_build_pip_package.vcxproj" (default ta
rget) (1) ->
"C:\Users\user\Documents\tensorflow\tensorflow\contrib\cmake\buildr1.8\pywrap_tensorflow_internal.vcxproj" (default tar
get) (2) ->
"C:\Users\user\Documents\tensorflow\tensorflow\contrib\cmake\buildr1.8\pywrap_tensorflow_internal_static.vcxproj" (defa
ult target) (3) ->
"C:\Users\user\Documents\tensorflow\tensorflow\contrib\cmake\buildr1.8\tf_c_python_api.vcxproj" (default target) (134)
->
(ClCompile target) ->
  C:\Users\user\Documents\tensorflow\tensorflow\c\python_api.cc(19): fatal error C1083: Cannot open include file: 'tens
orflow/python/framework/cpp_shape_inference.pb.h': No such file or directory [C:\Users\user\Documents\tensorflow\tensor
flow\contrib\cmake\buildr1.8\tf_c_python_api.vcxproj]

    20441 Warning(s)
    1 Error(s)

shivaniag · 2018-05-09T23:54:53Z

@gunan could you take a look.

gunan · 2018-05-10T06:42:20Z

It is possible we have missed a bug with /arch:AVX2.
Otherwise, I think there is an earlier protobuf error we are missing, that results in this file not being generated on your system. Since r1.8 builds just fine in our CI, I am not sure what may be going wrong for you.

yoshimur · 2018-05-10T11:30:26Z

I try to build v1.8 branch, but same error is occured.
In v 1.7.0 case, these command is works fine. I can get the Pip Package.
For this reason, I think this compile error was v1.8 related error.

darindf · 2018-05-10T17:00:59Z

What is generating this file? I can see if that part is working or not.

yoshimur · 2018-05-10T22:25:28Z

In v.1.7.0 case. generated file is "tensorflow_gpu-1.7.0-cp36-cp36m-win_amd64.whl"
And, I try some function, it seems work fine.
Sorry, can not attach the file, it is too big for attach.

sleighsoft · 2018-05-13T07:47:49Z

Is this also the reason why there are no new windows builds for tf-nightly right now?

gunan · 2018-05-13T17:57:51Z

No, on windows our CI has another issue we are working to solve right now.

…

On Sun, May 13, 2018 at 12:49 AM Julian Niedermeier < ***@***.***> wrote: Is this also the reason why there are no new windows builds for tf-nightly right now? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#19103 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AHlCOXkkXPDmhvewa5QKxXmEOHnBIGemks5tx-WNgaJpZM4TzfMK> .

steven-hh-ding · 2018-05-18T05:31:43Z

Same error here. Windows 10. VS 17. Master branch.

cmake .. -G "Visual Studio 15 2017 Win64" ^
 -T host=x64 ^
 -DCMAKE_BUILD_TYPE=RelWithDebInfo ^
 -DSWIG_EXECUTABLE=D:\tf-build\swigwin-3.0.12\swig.exe ^
 -DPYTHON_EXECUTABLE=D:\Program-Files\anaconda\envs\tensorflow\python.exe ^
 -DPYTHON_LIBRARIES=D:\Program-Files\anaconda\envs\tensorflow\libs\python35.lib ^
 -Dtensorflow_BUILD_PYTHON_TESTS=ON

MSBuild /p:Configuration=RelWithDebInfo tf_python_build_pip_package.vcxproj

msg:
d:\tf-build\tensorflow\tensorflow\c\python_api.cc(19): fatal error C1083: Cannot open include file: 'tensorflow/pytho
n/framework/cpp_shape_inference.pb.h': No such file or directory [D:\tf-build\tensorflow\tensorflow\contrib\cmake\tf18b
ld\tf_c_python_api.vcxproj]

gunan · 2018-05-18T06:04:55Z

Could you share the full log using pastebin?
The error message means a proto file failed to build somewhere earlier in the build.

steven-hh-ding · 2018-05-18T13:07:16Z

Looks like it is too big for pastebin. So I attach the log here. Thanks! @gunan

tf.mb.cmake.cpu.vs17.log

gunan · 2018-05-18T17:23:48Z

What you are seeing is different. In your case, you are running into this failure.
https://msdn.microsoft.com/en-us/library/zww6zdh7.aspx

You may want to try the "Release" configuration.

steven-hh-ding · 2018-05-19T01:14:51Z

Thank you @gunan . Using 'release' did remove all C2471. However C1083 is still there. Please find the attached log.
msbuild.log

Anyway, since I just need the header files to build an user_opr under windows. I use branch r1.7 instead.

HarryHHung · 2018-05-26T15:09:02Z

Thanks to @skydes's comment in #18931, I applied the patched line to tensorflow/contrib/cmake/tf_core_framework.cmake and successfully built r1.8.0 wheel with AVX2 support enabled.

yoshimur · 2018-06-06T19:55:46Z

Hi AshimaChawla I download cudnn-9.1-windows10-x64-v7.1.zip, and extract this zip file. You can find cuda/bin/cudnn64_7.dll, So copy this file to CUDA bin folder. In my case, copy it to C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v9.1\bin This works fine. Please try it. Best Regards. From: AshimaChawla <notifications@github.com> Sent: Thursday, June 7, 2018 3:48 AM To: tensorflow/tensorflow <tensorflow@noreply.github.com> Cc: Yoshihiro Yoshimura <yoshimura@yqs.jp>; Mention <mention@noreply.github.com> Subject: Re: [tensorflow/tensorflow] Build Pip Package Failed on Windows v1.8.0 with GPU (#19103) hi @yoshimur <https://github.com/yoshimur> , were u able to use tf after installing 1.7 version?? I am getting the below error: Could not find 'cudnn64_7.1.4.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Note that installing cuDNN is a separate step from installing CUDA, and this DLL is often found in a different directory from the CUDA DLLs. You may install the necessary DLL by downloading cuDNN 7.1.4 from this URL: https://developer.nvidia.com/cudnn Could you please guide. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#19103 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/ABBUB87Z0c36FNr2ypStCapPLnSp7lwcks5t6CPsgaJpZM4TzfMK> . <https://github.com/notifications/beacon/ABBUB2MBOEs6nEAIfCozR-hRVd_WiHTsks5t6CPsgaJpZM4TzfMK.gif>

AshimaChawla · 2018-06-07T11:14:55Z

Hi @yoshimur, Thanks very much..

Everything is working fine now..

The only issue I am seeing is when I execute my code, it seem to be bit slower than I used to execute on GPU. Is it something because of Windows ??

Is Ubuntu much faster than that?

/Ashima

tensorflowbutler · 2018-06-22T18:57:34Z

Nagging Assignees @gunan, @shivaniag: It has been 15 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

luranhe · 2018-06-24T00:27:56Z

I had the same problem (Win10, VS2015, CUDA 9.1, AVX2, with MKL, without gRPC).

I checked tensorflow/python/framework and saw that the cpp_shape_inference.pb.h file was in there. So I just ran the MSBuild command again and the build completed (WHL file produced)!

Lmk if I should include more info. This is my first post to a Github issue, plz be nice. :)

gunan · 2018-06-25T05:01:54Z

Thanks for the tip, this is really helpful.
Could you copy/paste your build output to pastebin for us to be able to see the error message?
@annarev According to the comment by @luranhe could this be a missing dependency in cmake for api generation?

luranhe · 2018-06-25T09:44:19Z

Unfortunately, I don't have the build output from the failed build anymore, I didn't save it anywhere and the command line only saves so much history. Many apologies.

It definitely failed on tf_c_python_api.vcxproj because of "no such file or directory" of file cpp_shape_inference.pb.h, which clearly existed at the indicated location.

tensorflowbutler assigned shivaniag May 5, 2018

shivaniag added the type:build/install Build and install issues label May 9, 2018

shivaniag assigned gunan May 9, 2018

shivaniag added the stat:awaiting tensorflower Status - Awaiting response from tensorflower label May 9, 2018

gunan added stat:awaiting response Status - Awaiting response from author and removed stat:awaiting tensorflower Status - Awaiting response from tensorflower labels May 10, 2018

tensorflowbutler removed the stat:awaiting response Status - Awaiting response from author label May 11, 2018

case540 closed this as completed in adc0342 Jun 26, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Build Pip Package Failed on Windows v1.8.0 with GPU #19103

Build Pip Package Failed on Windows v1.8.0 with GPU #19103

yoshimur commented May 5, 2018

darindf commented May 7, 2018

shivaniag commented May 9, 2018

gunan commented May 10, 2018

yoshimur commented May 10, 2018

darindf commented May 10, 2018

yoshimur commented May 10, 2018

sleighsoft commented May 13, 2018

gunan commented May 13, 2018 via email

steven-hh-ding commented May 18, 2018

gunan commented May 18, 2018

steven-hh-ding commented May 18, 2018

gunan commented May 18, 2018

steven-hh-ding commented May 19, 2018

HarryHHung commented May 26, 2018

yoshimur commented Jun 6, 2018 via email

AshimaChawla commented Jun 7, 2018

tensorflowbutler commented Jun 22, 2018

luranhe commented Jun 24, 2018

gunan commented Jun 25, 2018

luranhe commented Jun 25, 2018

Build Pip Package Failed on Windows v1.8.0 with GPU #19103

Build Pip Package Failed on Windows v1.8.0 with GPU #19103

Comments

yoshimur commented May 5, 2018

System information

darindf commented May 7, 2018

shivaniag commented May 9, 2018

gunan commented May 10, 2018

yoshimur commented May 10, 2018

darindf commented May 10, 2018

yoshimur commented May 10, 2018

sleighsoft commented May 13, 2018

gunan commented May 13, 2018 via email

steven-hh-ding commented May 18, 2018

gunan commented May 18, 2018

steven-hh-ding commented May 18, 2018

gunan commented May 18, 2018

steven-hh-ding commented May 19, 2018

HarryHHung commented May 26, 2018

yoshimur commented Jun 6, 2018 via email

AshimaChawla commented Jun 7, 2018

tensorflowbutler commented Jun 22, 2018

luranhe commented Jun 24, 2018

gunan commented Jun 25, 2018

luranhe commented Jun 25, 2018