RuntimeError: Ninja is required to load C++ extensions #20

GuangyanZhang · 2019-06-21T06:46:26Z

您好，首先我出现这样的问题：
RuntimeError: Ninja is required to load C++ extensions
然后我pip install ninja成功以后
又出现这样的问题：
/usr/local/lib/python3.5/dist-packages/torch/utils/cpp_extension.py:118: UserWarning:

                           !! WARNING !!

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Your compiler (c++) may be ABI-incompatible with PyTorch!
Please use a compiler that is ABI-compatible with GCC 4.9 and above.
See https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html.

See https://gist.github.com/goldsborough/d466f43e8ffc948ff92de7486c5216d6
for instructions on how to install GCC 4.9 or higher.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

                          !! WARNING !!

warnings.warn(ABI_INCOMPATIBILITY_WARNING.format(compiler))
Traceback (most recent call last):
File "tools/train.py", line 27, in
import models
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/models/init.py", line 11, in
import models.seg_hrnet
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/models/seg_hrnet.py", line 22, in
from .sync_bn.inplace_abn.bn import InPlaceABNSync
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/models/sync_bn/init.py", line 1, in
from .inplace_abn import bn
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/models/sync_bn/inplace_abn/init.py", line 1, in
from .bn import ABN, InPlaceABN, InPlaceABNSync
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/models/sync_bn/inplace_abn/bn.py", line 14, in
from functions import *
File "/data/HRNet-Semantic-Segmentation-master/lib/models/sync_bn/inplace_abn/functions.py", line 16, in
extra_cuda_cflags=["--expt-extended-lambda"])
File "/usr/local/lib/python3.5/dist-packages/torch/utils/cpp_extension.py", line 514, in load
with_cuda=with_cuda)
File "/usr/local/lib/python3.5/dist-packages/torch/utils/cpp_extension.py", line 690, in _jit_compile
return _import_module_from_library(name, build_directory)
File "/usr/local/lib/python3.5/dist-packages/torch/utils/cpp_extension.py", line 773, in _import_module_from_library
return imp.load_module(module_name, file, path, description)
File "/usr/lib/python3.5/imp.py", line 242, in load_module
return load_dynamic(name, filename, file)
File "/usr/lib/python3.5/imp.py", line 342, in load_dynamic
return _load(spec)
ImportError: /tmp/torch_extensions/inplace_abn/inplace_abn.so: undefined symbol: _ZN2at5ErrorC1ENS_14SourceLocationESs

请问这个BN和pytorch是要同步编译吗？我的pytorch==0.4.1

The text was updated successfully, but these errors were encountered:

GuangyanZhang · 2019-06-21T06:47:26Z

我该怎么操作才能解决这个问题呢？希望您能指导一下，谢谢

sunke123 · 2019-06-21T07:06:30Z

You can try this docker: kesun/pose:pytorch-0.4.1-bn-cudnn-off
If possible, you adopt the official sync-bn provided by pytorch.

GuangyanZhang · 2019-06-21T07:34:58Z

这个docker "kesun/pose:pytorch-0.4.1-bn-cudnn-off" 可以提供一个链接吗？谢谢！

sunke123 · 2019-06-21T07:53:46Z

https://cloud.docker.com/u/kesun/repository/docker/kesun/pose

I think you can pull this docker without any link.

GuangyanZhang · 2019-06-21T08:18:21Z

好的，非常感谢

sde123 · 2019-06-21T08:35:51Z

hi
your website 'https://cloud.docker.com/u/kesun/repository/docker/kesun/pose' is not working now. Could you tell me what is wrong?

GuangyanZhang · 2019-06-21T08:38:24Z

This site maybe requires over the wall,I think

sde123 · 2019-06-21T08:40:34Z

Hi
I can visit google,but I cannot visit this website,Therefore, it is not the reason of wall

GuangyanZhang · 2019-06-21T08:44:38Z

I think website is limitted,you can wait a moment.......

sunke123 · 2019-06-21T08:46:04Z

@GuangyanZhang @sde123
Sorry about that.
https://hub.docker.com/r/kesun/pose/.

However, I have no idea why you need to visit this website.
You can just run "docker pull kesun/pose:pytorch-0.4.1-bn-cudnn-off" to pull this image.

sde123 · 2019-06-21T08:46:19Z

Ok，Do you solve the above problem of BN and pytorch that you said？

GuangyanZhang · 2019-06-21T08:54:23Z

my website is limitted,so I want download by other computer.but I find that my environment cann't use docker.....

GuangyanZhang · 2019-06-21T08:59:34Z

@sde123 I don't,I should adopt the official sync-bn provided by pytorch.that's bad.

GuangyanZhang · 2019-06-24T06:35:28Z

@sde123 你好，之前那个搞定了，现在又出现这样的问题，我是不是哪里路径不对或者参数不对呢？，能指导下吗？
File "tools/train.py", line 245, in
main()
File "tools/train.py", line 56, in main
args = parse_args()
File "tools/train.py", line 51, in parse_args
update_config(config, args)
File "/data/HRNet-Semantic-Segmentation-master/tools/../lib/config/default.py", line 114, in update_config
cfg.merge_from_file(args.cfg)
File "/usr/local/lib/python3.5/dist-packages/yacs/config.py", line 171, in merge_from_file
self.merge_from_other_cfg(cfg)
File "/usr/local/lib/python3.5/dist-packages/yacs/config.py", line 175, in merge_from_other_cfg
_merge_a_into_b(cfg_other, self, self, [])
File "/usr/local/lib/python3.5/dist-packages/yacs/config.py", line 401, in _merge_a_into_b
_merge_a_into_b(v, b[k], root, key_list + [k])
File "/usr/local/lib/python3.5/dist-packages/yacs/config.py", line 401, in _merge_a_into_b
_merge_a_into_b(v, b[k], root, key_list + [k])
File "/usr/local/lib/python3.5/dist-packages/yacs/config.py", line 392, in _merge_a_into_b
raise KeyError("Non-existent config key: {}".format(full_key))
KeyError: 'Non-existent config key: MODEL.EXTRA.STAGE4'

jwnirvana · 2019-07-16T08:39:00Z

I am confused by this problem(ninjia),too. Could you teach me to solve it,please?

GuangyanZhang · 2019-07-16T10:58:55Z

you should install pytorch 0.4.0 and ninja~

frostinassiky · 2019-07-18T09:34:02Z

@GuangyanZhang Did you check your config (yaml) file? Does it contain STAGE4?

yanli-star · 2019-07-19T01:24:09Z

@GuangyanZhang 你好，我安装pytorch0.4.1和您出现了同样的问题，又安装了pytorch0.4.0和ninja，出现了下面这样的问题，请问您出现过吗，怎么解决呢？
File "tools/train.py", line 27, in
import models
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/init.py", line 11, in
import models.seg_hrnet
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/seg_hrnet.py", line 22, in
from .sync_bn.inplace_abn.bn import InPlaceABNSync
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/sync_bn/init.py", line 1, in
from .inplace_abn import bn
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/sync_bn/inplace_abn/init.py", line 1, in
from .bn import ABN, InPlaceABN, InPlaceABNSync
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/sync_bn/inplace_abn/bn.py", line 14, in
from functions import *
File "/root/userfolder/code/HRNet-Seg/tools/../lib/models/sync_bn/inplace_abn/functions.py", line 16, in
extra_cuda_cflags=["--expt-extended-lambda"])
File "/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/utils/cpp_extension.py", line 501, in load
_build_extension_module(name, build_directory)
File "/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/utils/cpp_extension.py", line 582, in _build_extension_module
name, error.output.decode()))
RuntimeError: Error building extension 'inplace_abn': ninja: warning: bad deps log signature or version; starting over
[1/4] /usr/local/cuda:/bin/nvcc -DTORCH_EXTENSION_NAME=inplace_abn -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/TH -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/THC -I/usr/local/cuda:/include -I/root/userfolder/anaconda3/envs/python27/include/python2.7 --compiler-options '-fPIC' --expt-extended-lambda -std=c++11 -c /root/userfolder/code/HRNet-Seg/lib/models/sync_bn/inplace_abn/src/inplace_abn_cuda.cu -o inplace_abn_cuda.cuda.o
FAILED: inplace_abn_cuda.cuda.o
/usr/local/cuda:/bin/nvcc -DTORCH_EXTENSION_NAME=inplace_abn -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/TH -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/THC -I/usr/local/cuda:/include -I/root/userfolder/anaconda3/envs/python27/include/python2.7 --compiler-options '-fPIC' --expt-extended-lambda -std=c++11 -c /root/userfolder/code/HRNet-Seg/lib/models/sync_bn/inplace_abn/src/inplace_abn_cuda.cu -o inplace_abn_cuda.cuda.o
/bin/sh: 1: /usr/local/cuda:/bin/nvcc: not found
[2/4] c++ -MMD -MF inplace_abn_cpu.o.d -DTORCH_EXTENSION_NAME=inplace_abn -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/TH -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/THC -I/usr/local/cuda:/include -I/root/userfolder/anaconda3/envs/python27/include/python2.7 -fPIC -std=c++11 -O3 -c /root/userfolder/code/HRNet-Seg/lib/models/sync_bn/inplace_abn/src/inplace_abn_cpu.cpp -o inplace_abn_cpu.o
[3/4] c++ -MMD -MF inplace_abn.o.d -DTORCH_EXTENSION_NAME=inplace_abn -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/TH -I/root/userfolder/anaconda3/envs/python27/lib/python2.7/site-packages/torch/lib/include/THC -I/usr/local/cuda:/include -I/root/userfolder/anaconda3/envs/python27/include/python2.7 -fPIC -std=c++11 -O3 -c /root/userfolder/code/HRNet-Seg/lib/models/sync_bn/inplace_abn/src/inplace_abn.cpp -o inplace_abn.o
ninja: build stopped: subcommand failed.

GuangyanZhang · 2019-07-19T08:24:59Z

@frostinassiky you should change the default.py~

GuangyanZhang · 2019-07-19T08:26:36Z

@yanyunyun ,没有出现过，这个应该还是ninja的问题

sxhsunday · 2019-10-29T04:37:32Z

@yanyunyun
Seg/lib/models/sync_bn/inplace_abn/src/inplace_abn.cpp -o inplace_abn.o
ninja: build stopped: subcommand failed.
did you solve this problem?

yanli-star · 2019-10-29T06:18:14Z

@sxhsunday
I solved this issue by installing pytorch 1.1 and using pytorch-v1.1 branch.

sxhsunday · 2019-10-29T06:51:01Z

@yanyunyun
Thank you very much. it is work now.

kaishijeng · 2020-01-17T06:27:32Z

@sxhsunday @yanyunyun

I install pytorch 1.1 using conda and checkout pytorch v1.1 branch. However, I still got the same error.
Can you provide instruction how you install pytorch 1.1 and checkout pytorch v1.1 branch?
ALso which version ninja fo you use?

Thanks,

neverstoplearn · 2020-01-28T08:44:10Z

@sxhsunday @yanyunyun

I install pytorch 1.1 using conda and checkout pytorch v1.1 branch. However, I still got the same error.
Can you provide instruction how you install pytorch 1.1 and checkout pytorch v1.1 branch?
ALso which version ninja fo you use?

Thanks,

I have the same error as you have you solve it? thanks,

kaizen0890 · 2020-03-19T07:33:06Z

I found that this error relates to version matching problem, specifying between Torch and ninja version.
Therefore I solved this problem by finding ninja version which matching with Torch version.
My environment as show as below:
Ubuntu: 16.04
Gcc: 6.5.0
Python: 3.5.2
Torch: 0.4.1
ninja: 1.8.2
Hopefully that it can help you guys!

iris0329 · 2020-04-09T07:55:16Z

@sxhsunday
I solved this issue by installing pytorch 1.1 and using pytorch-v1.1 branch.

It works!

YijianLiu mentioned this issue Aug 20, 2019

RuntimeError: weight tensor should be defined either for all or no classes #41

Closed

YijianLiu mentioned this issue Sep 3, 2019

RuntimeError: cuda runtime error (59) : device-side assert triggered at /opt/conda/conda-bld/pytorch_1535491974311/work/aten/src/THC/generated/../THCReduceAll.cuh:317 terminate called after throwing an instance of 'at::Error' #50

Closed

welleast closed this as completed Dec 11, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RuntimeError: Ninja is required to load C++ extensions #20

RuntimeError: Ninja is required to load C++ extensions #20

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 24, 2019

jwnirvana commented Jul 16, 2019

GuangyanZhang commented Jul 16, 2019

frostinassiky commented Jul 18, 2019

yanli-star commented Jul 19, 2019

GuangyanZhang commented Jul 19, 2019

GuangyanZhang commented Jul 19, 2019

sxhsunday commented Oct 29, 2019

yanli-star commented Oct 29, 2019

sxhsunday commented Oct 29, 2019

kaishijeng commented Jan 17, 2020

neverstoplearn commented Jan 28, 2020

kaizen0890 commented Mar 19, 2020

iris0329 commented Apr 9, 2020

RuntimeError: Ninja is required to load C++ extensions #20

RuntimeError: Ninja is required to load C++ extensions #20

Comments

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

sunke123 commented Jun 21, 2019

sde123 commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 21, 2019

GuangyanZhang commented Jun 24, 2019

jwnirvana commented Jul 16, 2019

GuangyanZhang commented Jul 16, 2019

frostinassiky commented Jul 18, 2019

yanli-star commented Jul 19, 2019

GuangyanZhang commented Jul 19, 2019

GuangyanZhang commented Jul 19, 2019

sxhsunday commented Oct 29, 2019

yanli-star commented Oct 29, 2019

sxhsunday commented Oct 29, 2019

kaishijeng commented Jan 17, 2020

neverstoplearn commented Jan 28, 2020

kaizen0890 commented Mar 19, 2020

iris0329 commented Apr 9, 2020