ninja: build stopped: subcommand failed. #140

sanersbug · 2018-10-25T05:42:19Z

After i installed ninja , When i run
python main.py --dataset cifar10 --model encnetdrop --widen 8 --ncodes 32 --resume model/encnet_cifar.pth.tar --eval

it shows the error:

/home/anaconda3/lib/python3.6/site-packages/torch/utils/cpp_extension.py:118: UserWarning:

                           !! WARNING !!

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Your compiler (c++) may be ABI-incompatible with PyTorch!
Please use a compiler that is ABI-compatible with GCC 4.9 and above.
See https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html.

See https://gist.github.com/goldsborough/d466f43e8ffc948ff92de7486c5216d6
for instructions on how to install GCC 4.9 or higher.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

                          !! WARNING !!

warnings.warn(ABI_INCOMPATIBILITY_WARNING.format(compiler))
Traceback (most recent call last):
File "/home/anaconda3/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 759, in _build_extension_module
['ninja', '-v'], stderr=subprocess.STDOUT, cwd=build_directory)
File "/home/anaconda3/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/home/anaconda3/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "main.py", line 24, in
from encoding.utils import *
File "/home/anaconda3/lib/python3.6/site-packages/encoding/init.py", line 13, in
from . import nn, functions, dilated, parallel, utils, models, datasets
File "/home/anaconda3/lib/python3.6/site-packages/encoding/nn/init.py", line 12, in
from .encoding import *
File "/home/anaconda3/lib/python3.6/site-packages/encoding/nn/encoding.py", line 18, in
from ..functions import scaled_l2, aggregate, pairwise_cosine
File "/home/anaconda3/lib/python3.6/site-packages/encoding/functions/init.py", line 2, in
from .encoding import *
File "/home/anaconda3/lib/python3.6/site-packages/encoding/functions/encoding.py", line 14, in
from .. import lib
File "/home/anaconda3/lib/python3.6/site-packages/encoding/lib/init.py", line 15, in
], build_directory=cpu_path, verbose=False)
File "/home/anaconda3/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 514, in load
with_cuda=with_cuda)
File "/home/anaconda3/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 682, in _jit_compile
_build_extension_module(name, build_directory)
File "/home/anaconda3/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 765, in _build_extension_module
name, error.output.decode()))
RuntimeError: Error building extension 'enclib_cpu': [1/4] c++ -MMD -MF syncbn_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/syncbn_cpu.cpp -o syncbn_cpu.o
FAILED: syncbn_cpu.o
c++ -MMD -MF syncbn_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/syncbn_cpu.cpp -o syncbn_cpu.o
/home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/syncbn_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
[2/4] c++ -MMD -MF roi_align_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/roi_align_cpu.cpp -o roi_align_cpu.o
FAILED: roi_align_cpu.o
c++ -MMD -MF roi_align_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/roi_align_cpu.cpp -o roi_align_cpu.o
/home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/roi_align_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
[3/4] c++ -MMD -MF nms_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/nms_cpu.cpp -o nms_cpu.o
FAILED: nms_cpu.o
c++ -MMD -MF nms_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/TH -I/home/anaconda3/lib/python3.6/site-packages/torch/lib/include/THC -I/home/anaconda3/include/python3.6m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/nms_cpu.cpp -o nms_cpu.o
/home/anaconda3/lib/python3.6/site-packages/encoding/lib/cpu/nms_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
ninja: build stopped: subcommand failed.

The text was updated successfully, but these errors were encountered:

zhanghang1989 · 2018-10-25T14:43:54Z

That looks like PyTorch problem.

dongzhang89 · 2018-11-13T04:23:08Z

hi, have you solved this problem ?

SuperMousse · 2018-11-13T14:14:17Z

Wow, I have faced with the same problem. But I have an gcc version of 5.4.0, I don't know why.

VanNope · 2018-11-13T16:05:24Z

Hello! im getting the same error when i try running model/download_models.py
Did anyone manage to solve this issue?

zhanghang1989 · 2018-11-13T17:58:43Z

Please change torch/torch.h to torch/extension.h. This is because rapid updates in PyTorch.

VanNope · 2018-11-14T10:50:09Z

Thanks for the quick reply.
Unfortunately the error message persists even after changing the name.
(I changed pipPath/torch/lib/include/torch/torch.h to extension.h, where pipPath = folder that includes all pip installs).

Heres the error message i get when running model/download_models.py. I will highlight the errors in bold with gcc version5.4.0:

`
/home/ev/.local/lib/python3.5/site-packages/torch/utils/cpp_extension.py:118: UserWarning:

                           !! WARNING !!

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Your compiler (c++) may be ABI-incompatible with PyTorch!
Please use a compiler that is ABI-compatible with GCC 4.9 and above.
See https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html.

See https://gist.github.com/goldsborough/d466f43e8ffc948ff92de7486c5216d6
for instructions on how to install GCC 4.9 or higher.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

                          !! WARNING !!

warnings.warn(ABI_INCOMPATIBILITY_WARNING.format(compiler))
Traceback (most recent call last):
File "/home/ev/.local/lib/python3.5/site-packages/torch/utils/cpp_extension.py", line 759, in _build_extension_module
['ninja', '-v'], stderr=subprocess.STDOUT, cwd=build_directory)
File "/usr/lib/python3.5/subprocess.py", line 626, in check_output
**kwargs).stdout
File "/usr/lib/python3.5/subprocess.py", line 708, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "model/download_models.py", line 1, in
import encoding
File "/home/ev/.local/lib/python3.5/site-packages/encoding/init.py", line 13, in
from . import nn, functions, dilated, parallel, utils, models, datasets
File "/home/ev/.local/lib/python3.5/site-packages/encoding/nn/init.py", line 12, in
from .encoding import *
File "/home/ev/.local/lib/python3.5/site-packages/encoding/nn/encoding.py", line 18, in
from ..functions import scaled_l2, aggregate, pairwise_cosine
File "/home/ev/.local/lib/python3.5/site-packages/encoding/functions/init.py", line 2, in
from .encoding import *
File "/home/ev/.local/lib/python3.5/site-packages/encoding/functions/encoding.py", line 14, in
from .. import lib
File "/home/ev/.local/lib/python3.5/site-packages/encoding/lib/init.py", line 15, in
], build_directory=cpu_path, verbose=False)
File "/home/evangello/.local/lib/python3.5/site-packages/torch/utils/cpp_extension.py", line 514, in load
with_cuda=with_cuda)
File "/home/evangello/.local/lib/python3.5/site-packages/torch/utils/cpp_extension.py", line 682, in _jit_compile
_build_extension_module(name, build_directory)
File "/home/ev/.local/lib/python3.5/site-packages/torch/utils/cpp_extension.py", line 765, in _build_extension_module
name, error.output.decode()))
RuntimeError: Error building extension 'enclib_cpu': [1/4] c++ -MMD -MF syncbn_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/syncbn_cpu.cpp -o syncbn_cpu.o
FAILED: syncbn_cpu.o
c++ -MMD -MF syncbn_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/syncbn_cpu.cpp -o syncbn_cpu.o
/home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/syncbn_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
[2/4] c++ -MMD -MF roi_align_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/roi_align_cpu.cpp -o roi_align_cpu.o
FAILED: roi_align_cpu.o
c++ -MMD -MF roi_align_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/roi_align_cpu.cpp -o roi_align_cpu.o
/home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/roi_align_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
[3/4] c++ -MMD -MF nms_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/nms_cpu.cpp -o nms_cpu.o
FAILED: nms_cpu.o
c++ -MMD -MF nms_cpu.o.d -DTORCH_EXTENSION_NAME=enclib_cpu -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/TH -I/home/ev/.local/lib/python3.5/site-packages/torch/lib/include/THC -I/usr/include/python3.5m -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++11 -c /home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/nms_cpu.cpp -o nms_cpu.o
/home/ev/.local/lib/python3.5/site-packages/encoding/lib/cpu/nms_cpu.cpp:1:26: fatal error: torch/tensor.h: No such file or directory
compilation terminated.
ninja: build stopped: subcommand failed.
`

zhanghang1989 · 2018-11-14T17:11:11Z

see my previous comment #140 (comment)

SuperMousse · 2018-11-18T01:59:44Z

I found that the problem is that the position of <torch/tensor.h> has been changed , it's in <torch/serialize/tensor.h> now. I changed the code and solved my prolem.

Hanhanhan11 · 2018-11-19T05:45:31Z

I found that the problem is that the position of <torch/tensor.h> has been changed , it's in <torch/serialize/tensor.h> now. I changed the code and solved my prolem.

Hi, which version of pytorch do you use??

SuperMousse · 2018-11-19T06:08:14Z

This is the version of pytorch. I use the master branch of Nov, 17. But I think may be v1.0 will help after change the code.
ps:CUDA=9.0, CUDNN=7.0. I wish that these will help.

zhanghang1989 · 2018-11-19T18:11:58Z

Please change torch/torch.h to torch/extension.h. This is because rapid updates in PyTorch.

lfdeep · 2018-11-29T03:22:21Z

I found that the problem is that the position of <torch/tensor.h> has been changed , it's in <torch/serialize/tensor.h> now. I changed the code and solved my prolem.

Hello, i meet the same problems, i want to know how to change the code? than you

SuperMousse · 2018-11-29T03:36:39Z

I found that the problem is that the position of <torch/tensor.h> has been changed , it's in <torch/serialize/tensor.h> now. I changed the code and solved my prolem.

Hello, i meet the same problems, i want to know how to change the code? than you

At first I tried what @zhanghang1989 said " Please change torch/torch.h to torch/extension.h. " .But it didn't solve my problem. I found that the error was that <torch/tensor.h> couldnot be found, so I changed all the "#include <torch/tensor.h>" in cpp files to "#include <torch/serialize/tensor.h>". Maybe the position of "tensor.h" can be different, you can change the path in your own system. Hope this will help.

XiaofanLinUS · 2018-11-30T09:20:10Z

I found that the problem is that the position of <torch/tensor.h> has been changed , it's in <torch/serialize/tensor.h> now. I changed the code and solved my prolem.

Hello, i meet the same problems, i want to know how to change the code? than you

At first I tried what @zhanghang1989 said " Please change torch/torch.h to torch/extension.h. " .But it didn't solve my problem. I found that the error was that <torch/tensor.h> couldnot be found, so I changed all the "#include <torch/tensor.h>" in cpp files to "#include <torch/serialize/tensor.h>". Maybe the position of "tensor.h" can be different, you can change the path in your own system. Hope this will help.

I have the same problem as yours.

Cverlpeng · 2019-04-10T02:59:35Z

Please change torch/torch.h to torch/extension.h. This is because rapid updates in PyTorch.

hi, Rename torch.h to extension.h ?

tangky22 · 2022-10-05T09:10:41Z

Please change torch/torch.h to torch/extension.h. This is because rapid updates in PyTorch.

hi, Rename torch.h to extension.h ?

hi, have you solve the problem? I met the same problem in pytorch=1.7 torch-encoding=1.2.1

zhanghang1989 · 2022-10-05T23:59:07Z

Please uninstall the torch-encoding and reinstall it following the instruction at https://hangzhang.org/PyTorch-Encoding/notes/compile.html

tangky22 · 2022-10-06T04:44:09Z

Please uninstall the torch-encoding and reinstall it following the instruction at https://hangzhang.org/PyTorch-Encoding/notes/compile.html

Thanks for your reply! Should I reinstall the torch-encoding using Ubuntu? I didn't find the instruction for Windows10 using Anaconda

zhanghang1989 added bug high priority labels Nov 13, 2018

zhanghang1989 mentioned this issue Nov 13, 2018

Cannot import encoding #70

Open

zhanghang1989 mentioned this issue Dec 17, 2018

V1.0.0 #156

Merged

zhanghang1989 closed this as completed in #156 Dec 17, 2018

dekura mentioned this issue Apr 25, 2019

undefined symbol: _Z23LeakyRelu_Backward_CUDAN2at6TensorES0_f Tramac/awesome-semantic-segmentation-pytorch#11

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ninja: build stopped: subcommand failed. #140

ninja: build stopped: subcommand failed. #140

sanersbug commented Oct 25, 2018

zhanghang1989 commented Oct 25, 2018

dongzhang89 commented Nov 13, 2018

SuperMousse commented Nov 13, 2018 •

edited

VanNope commented Nov 13, 2018 •

edited

zhanghang1989 commented Nov 13, 2018

VanNope commented Nov 14, 2018 •

edited

zhanghang1989 commented Nov 14, 2018

SuperMousse commented Nov 18, 2018

Hanhanhan11 commented Nov 19, 2018

SuperMousse commented Nov 19, 2018 •

edited

zhanghang1989 commented Nov 19, 2018

lfdeep commented Nov 29, 2018

SuperMousse commented Nov 29, 2018 •

edited

XiaofanLinUS commented Nov 30, 2018 •

edited

Cverlpeng commented Apr 10, 2019 •

edited

tangky22 commented Oct 5, 2022

zhanghang1989 commented Oct 5, 2022

tangky22 commented Oct 6, 2022

ninja: build stopped: subcommand failed. #140

ninja: build stopped: subcommand failed. #140

Comments

sanersbug commented Oct 25, 2018

zhanghang1989 commented Oct 25, 2018

dongzhang89 commented Nov 13, 2018

SuperMousse commented Nov 13, 2018 • edited

VanNope commented Nov 13, 2018 • edited

zhanghang1989 commented Nov 13, 2018

VanNope commented Nov 14, 2018 • edited

zhanghang1989 commented Nov 14, 2018

SuperMousse commented Nov 18, 2018

Hanhanhan11 commented Nov 19, 2018

SuperMousse commented Nov 19, 2018 • edited

zhanghang1989 commented Nov 19, 2018

lfdeep commented Nov 29, 2018

SuperMousse commented Nov 29, 2018 • edited

XiaofanLinUS commented Nov 30, 2018 • edited

Cverlpeng commented Apr 10, 2019 • edited

tangky22 commented Oct 5, 2022

zhanghang1989 commented Oct 5, 2022

tangky22 commented Oct 6, 2022

SuperMousse commented Nov 13, 2018 •

edited

VanNope commented Nov 13, 2018 •

edited

VanNope commented Nov 14, 2018 •

edited

SuperMousse commented Nov 19, 2018 •

edited

SuperMousse commented Nov 29, 2018 •

edited

XiaofanLinUS commented Nov 30, 2018 •

edited

Cverlpeng commented Apr 10, 2019 •

edited