Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CompileError: command 'gcc' failed with exit status 1 #235

Closed
DaVilla7 opened this issue Jul 10, 2018 · 33 comments · Fixed by #286
Closed

CompileError: command 'gcc' failed with exit status 1 #235

DaVilla7 opened this issue Jul 10, 2018 · 33 comments · Fixed by #286

Comments

@DaVilla7
Copy link

DaVilla7 commented Jul 10, 2018

I use anaconda(with python3.6) and cuda9.0(GTX1070), when I compile the make.sh, I got a problem which displayed:

root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib# sh make.sh
running build_ext
skipping 'model/utils/bbox.c' Cython extension (up-to-date)
skipping 'pycocotools/_mask.c' Cython extension (up-to-date)
Compiling nms kernels by nvcc...
Including CUDA code.
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms
['/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda_kernel.cu.o']
generating /tmp/tmpsosri8sf/_nms.c
setting the current directory to '/tmp/tmpsosri8sf'
running build_ext
building '_nms' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _nms.c -o ./_nms.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.o -std=c99
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c: In function ‘nms_cuda’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c:14:22: error: dereferencing pointer to incomplete type ‘THCTensor {aka struct THCTensor}’
boxes_host->size[0],
^
Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/root/anaconda3/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "build.py", line 37, in
ffi.build()
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1
Compiling roi pooling kernels by nvcc...
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling
Including CUDA code.
generating /tmp/tmpgb2kylxp/_roi_pooling.c
setting the current directory to '/tmp/tmpgb2kylxp'
running build_ext
building '_roi_pooling' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _roi_pooling.c -o ./_roi_pooling.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling_cuda.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling_cuda.o -std=c99
gcc -pthread -shared -B /root/anaconda3/compiler_compat -L/root/anaconda3/lib -Wl,-rpath=/root/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -std=c99 ./_roi_pooling.o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling.o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling_cuda.o /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_pooling/src/roi_pooling.cu.o -o ./_roi_pooling.so
Compiling roi align kernels by nvcc...
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align
Including CUDA code.
generating /tmp/tmphjs0kouq/_roi_align.c
setting the current directory to '/tmp/tmphjs0kouq'
running build_ext
building '_roi_align' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _roi_align.c -o ./_roi_align.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.o -std=c99
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c: In function ‘roi_align_backward’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c:65:9: warning: unused variable ‘batch_size’ [-Wunused-variable]
int batch_size = THFloatTensor_size(bottom_grad, 0);
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c: In function ‘ROIAlignForwardCpu’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c:87:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
#pragma omp parallel for
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c: In function ‘ROIAlignBackwardCpu’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.c:145:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
#pragma omp parallel for
^
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align_cuda.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align_cuda.o -std=c99
gcc -pthread -shared -B /root/anaconda3/compiler_compat -L/root/anaconda3/lib -Wl,-rpath=/root/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -std=c99 ./_roi_align.o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align.o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align_cuda.o /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_align/src/roi_align_kernel.cu.o -o ./_roi_align.so
Compiling roi crop kernels by nvcc...
Including CUDA code.
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop
generating /tmp/tmpecg3_z_m/_roi_crop.c
setting the current directory to '/tmp/tmpecg3_z_m'
running build_ext
building '_roi_crop' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _roi_crop.c -o ./_roi_crop.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.o -std=c99
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBHWD_updateOutput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:10:30: error: dereferencing pointer to incomplete type ‘THTensor {aka struct THTensor}’
int batchsize = inputImages->size[0];
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBHWD_updateGradInput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:190:14: warning: unused variable ‘inBottomRight’ [-Wunused-variable]
real inBottomRight=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:189:14: warning: unused variable ‘inBottomLeft’ [-Wunused-variable]
real inBottomLeft=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:188:14: warning: unused variable ‘inTopRight’ [-Wunused-variable]
real inTopRight=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:187:14: warning: unused variable ‘inTopLeft’ [-Wunused-variable]
real inTopLeft=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:186:14: warning: unused variable ‘v’ [-Wunused-variable]
real v=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBCHW_updateGradInput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:441:14: warning: unused variable ‘inBottomRight’ [-Wunused-variable]
real inBottomRight=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:440:14: warning: unused variable ‘inBottomLeft’ [-Wunused-variable]
real inBottomLeft=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:439:14: warning: unused variable ‘inTopRight’ [-Wunused-variable]
real inTopRight=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:438:14: warning: unused variable ‘inTopLeft’ [-Wunused-variable]
real inTopLeft=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:437:14: warning: unused variable ‘v’ [-Wunused-variable]
real v=0;
^
Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/root/anaconda3/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "build.py", line 36, in
ffi.build()
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1
root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib#


Here is my make.sh:

export CUDA_PATH=/usr/local/cuda/

python setup.py build_ext --inplace
rm -rf build

CUDA_ARCH="-gencode arch=compute_60,code=sm_60 "

cd model/nms/src
echo "Compiling nms kernels by nvcc..."
nvcc -c -o nms_cuda_kernel.cu.o nms_cuda_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH

cd ../
python build.py

cd ../../
cd model/roi_pooling/src
echo "Compiling roi pooling kernels by nvcc..."
nvcc -c -o roi_pooling.cu.o roi_pooling_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py

cd ../../
cd model/roi_align/src
echo "Compiling roi align kernels by nvcc..."
nvcc -c -o roi_align_kernel.cu.o roi_align_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py

cd ../../
cd model/roi_crop/src
echo "Compiling roi crop kernels by nvcc..."
nvcc -c -o roi_crop_cuda_kernel.cu.o roi_crop_cuda_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py


Are there any problems with my gcc or Anaconda? Or how do I compile it with python3.6?(Just see the introduction "The default version is compiled with Python 2.7, please compile by yourself if you are using a different python version.") I'm looking forward to an answer

@xuw080
Copy link

xuw080 commented Jul 10, 2018

You can try to add:
export CXXFLAGS="-std=c++11"
export CFLAGS="-std=c99"
on top of make.sh.

@DaVilla7
Copy link
Author

@xuw080 Thank you for your respond, I tried in this way but it did not work

@xuw080
Copy link

xuw080 commented Jul 10, 2018

Did you check your CUDA_ARCH is correct? Also, you need to check whether you have used correct cuda path. I solved my problems after changing them.

@DaVilla7
Copy link
Author

DaVilla7 commented Jul 10, 2018

@xuw080 Yes, I use GTX1070 with the GUDA_ARCH " CUDA_ARCH="-gencode arch=compute_61,code=sm_61 " "
and I add
export LD_LIBRARY_PATH=/usr/local/cuda-9.0/lib64:$LD_LIBRARY_PATH
export PATH=/usr/local/cuda-9.0/bin:$PATH
in my /etc/profile, this fold exists
I think it's may correct

@DaVilla7
Copy link
Author

@jwyang could you please offer me some suggestion?

@DaVilla7
Copy link
Author

@jwyang I separated the four compiled steps as showed in the make.sh. I'm sure now that I have obtained the four .o file(nms_cuda_kernel.cu.o/roi_align_kernel.cu.o/roi_crop_cuda_kernel.cu.o/roi_pooling.cu.o)
However, when used the "python build.py", the "roi_align" and "roi_pooling" succeeded while the "nms" and the "crop" failed. These are logs


python build.py in nms:

root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms# python build.py
Including CUDA code.
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms
['/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda_kernel.cu.o']
generating /tmp/tmpauvv3ywc/_nms.c
setting the current directory to '/tmp/tmpauvv3ywc'
running build_ext
building '_nms' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _nms.c -o ./_nms.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.o -std=c99
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c: In function ‘nms_cuda’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c:14:22: error: dereferencing pointer to incomplete type ‘THCTensor {aka struct THCTensor}’
boxes_host->size[0],
^~
Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/root/anaconda3/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "build.py", line 37, in
ffi.build()
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1
root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/nms#


python build.py in crop

root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop# python build.py
Including CUDA code.
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop
generating /tmp/tmpkoapynf4/_roi_crop.c
setting the current directory to '/tmp/tmpkoapynf4'
running build_ext
building '_roi_crop' extension
creating home
creating home/mqxwd68
creating home/mqxwd68/Downloads
creating home/mqxwd68/Downloads/pytorchFiles
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop
creating home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c _roi_crop.c -o ./_roi_crop.o -std=c99
gcc -pthread -B /root/anaconda3/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -fPIC -DWITH_CUDA -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/root/anaconda3/include/python3.6m -c /home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c -o ./home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.o -std=c99
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBHWD_updateOutput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:10:30: error: dereferencing pointer to incomplete type ‘THTensor {aka struct THTensor}’
int batchsize = inputImages->size[0];
^~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBHWD_updateGradInput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:190:14: warning: unused variable ‘inBottomRight’ [-Wunused-variable]
real inBottomRight=0;
^~~~~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:189:14: warning: unused variable ‘inBottomLeft’ [-Wunused-variable]
real inBottomLeft=0;
^~~~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:188:14: warning: unused variable ‘inTopRight’ [-Wunused-variable]
real inTopRight=0;
^~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:187:14: warning: unused variable ‘inTopLeft’ [-Wunused-variable]
real inTopLeft=0;
^~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:186:14: warning: unused variable ‘v’ [-Wunused-variable]
real v=0;
^
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c: In function ‘BilinearSamplerBCHW_updateGradInput’:
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:441:14: warning: unused variable ‘inBottomRight’ [-Wunused-variable]
real inBottomRight=0;
^~~~~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:440:14: warning: unused variable ‘inBottomLeft’ [-Wunused-variable]
real inBottomLeft=0;
^~~~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:439:14: warning: unused variable ‘inTopRight’ [-Wunused-variable]
real inTopRight=0;
^~~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:438:14: warning: unused variable ‘inTopLeft’ [-Wunused-variable]
real inTopLeft=0;
^~~~~~~~~
/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop.c:437:14: warning: unused variable ‘v’ [-Wunused-variable]
real v=0;
^
Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/root/anaconda3/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/root/anaconda3/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/root/anaconda3/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/root/anaconda3/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/root/anaconda3/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "build.py", line 36, in
ffi.build()
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/root/anaconda3/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/root/anaconda3/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1
root@mqxwd68-System-Product-Name:/home/mqxwd68/Downloads/pytorchFiles/faster-rcnn.pytorch/lib/model/roi_crop#

@zzksdu
Copy link

zzksdu commented Jul 17, 2018

Does your project work? How to tackle the issues?

@ONLY-VEDA
Copy link

ONLY-VEDA commented Jul 19, 2018

@zzksdu @DaVilla7
I met the same problem, and I find that my pytorch was built from source,and the version is 0.5a, then I switch back to 0.4, the problem is gone. Hope to help you guys.

@yudawen
Copy link

yudawen commented Jul 30, 2018

@DaVilla7 Hi!I met the same problem with you.Did you solve your problem?Hope your answer!

@liyueqiao
Copy link

I met the same problem, and I seperate the four steps as well, only roi_crop failed, the error is the same. Did you solve it?

@huohuotm
Copy link

@yudawen @liyueqiao
I downgrade pytorch version from 0.4.1 to 0.4.0, it works for me.

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@liyueqiao @yudawen @zzksdu
sorry to reply you so late, I finally changed the version of pytorch to 0.4.0 and resolved the problem. By the way, the parameters of my pc are :
anaconda(with python3.6) and cuda9.0(GTX1070) gcc-4.8.
My make.sh file is illustrated in the following:

#!/usr/bin/env bash

# CUDA_PATH=/usr/local/cuda/

export CUDA_PATH=/usr/local/cuda/
export CXXFLAGS="-std=c++11"
export CFLAGS="-std=c99"

export PATH=/usr/local/cuda-9.0/bin${PATH:+:${PATH}}
export CPATH=/usr/local/cuda-9.0/include${CPATH:+:${CPATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-9.0/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

python setup.py build_ext --inplace
rm -rf build

CUDA_ARCH="-gencode arch=compute_30,code=sm_30 \
           -gencode arch=compute_35,code=sm_35 \
           -gencode arch=compute_50,code=sm_50 \
           -gencode arch=compute_52,code=sm_52 \
           -gencode arch=compute_60,code=sm_60 \
           -gencode arch=compute_61,code=sm_61 "
#CUDA_ARCH="-gencode arch=compute_60,code=sm_60"

# compile NMS
cd model/nms/src
echo "Compiling nms kernels by nvcc..."
nvcc -c -o nms_cuda_kernel.cu.o nms_cuda_kernel.cu \
	 -D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH

cd ../
python build.py

# compile roi_pooling
cd ../../
cd model/roi_pooling/src
echo "Compiling roi pooling kernels by nvcc..."
nvcc -c -o roi_pooling.cu.o roi_pooling_kernel.cu \
	 -D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py

# compile roi_align
cd ../../
cd model/roi_align/src
echo "Compiling roi align kernels by nvcc..."
nvcc -c -o roi_align_kernel.cu.o roi_align_kernel.cu \
	 -D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py

# compile roi_crop
cd ../../
cd model/roi_crop/src
echo "Compiling roi crop kernels by nvcc..."
nvcc -c -o roi_crop_cuda_kernel.cu.o roi_crop_cuda_kernel.cu \
	 -D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
python build.py

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@ONLY-VEDA @huohuotm
thank you for such helpful suggestions!

@liyueqiao
Copy link

Thanks a lot but it didn't fix my problem.
I seperate the four files and all four file can compile but nms and roi_crop failed using their build.py
The errors are as follows:
python model/nms/build.py

Including CUDA code.
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms
['/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda_kernel.cu.o']
generating /tmp/tmpwub4_afx/_nms.c
setting the current directory to '/tmp/tmpwub4_afx'
running build_ext
building '_nms' extension
creating data
creating data/home
creating data/home/liyueqiao
creating data/home/liyueqiao/adv2018
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -m64 -fPIC -m64 -fPIC -fPIC -DWITH_CUDA -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/liyueqiao/anaconda3/envs/py3.6/include/python3.6m -c _nms.c -o ./_nms.o -std=c99
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -m64 -fPIC -m64 -fPIC -fPIC -DWITH_CUDA -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/liyueqiao/anaconda3/envs/py3.6/include/python3.6m -c /data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c -o ./data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.o -std=c99
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c: In function ‘nms_cuda’:
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c:14:22: error: dereferencing pointer to incomplete type
boxes_host->size[0],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/nms/src/nms_cuda.c:15:22: error: dereferencing pointer to incomplete type
boxes_host->size[1],
^
Traceback (most recent call last):
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "model/nms/build.py", line 37, in
ffi.build()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1

python model/roi_crop/build.py

Including CUDA code.
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop
generating /tmp/tmpmjjpdlrf/_roi_crop.c
setting the current directory to '/tmp/tmpmjjpdlrf'
running build_ext
building '_roi_crop' extension
creating data
creating data/home
creating data/home/liyueqiao
creating data/home/liyueqiao/adv2018
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop
creating data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -m64 -fPIC -m64 -fPIC -fPIC -DWITH_CUDA -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/liyueqiao/anaconda3/envs/py3.6/include/python3.6m -c _roi_crop.c -o ./_roi_crop.o -std=c99
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -m64 -fPIC -m64 -fPIC -fPIC -DWITH_CUDA -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/liyueqiao/anaconda3/envs/py3.6/include/python3.6m -c /data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c -o ./data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.o -std=c99
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c: In function ‘BilinearSamplerBHWD_updateOutput_cuda’:
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:22:64: error: dereferencing pointer to incomplete type
success = BilinearSamplerBHWD_updateOutput_cuda_kernel(output->size[1],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:23:54: error: dereferencing pointer to incomplete type
output->size[3],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:24:54: error: dereferencing pointer to incomplete type
output->size[2],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:25:54: error: dereferencing pointer to incomplete type
output->size[0],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c: In function ‘BilinearSamplerBHWD_updateGradInput_cuda’:
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:65:71: error: dereferencing pointer to incomplete type
success = BilinearSamplerBHWD_updateGradInput_cuda_kernel(gradOutput->size[1],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:66:61: error: dereferencing pointer to incomplete type
gradOutput->size[3],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:67:61: error: dereferencing pointer to incomplete type
gradOutput->size[2],
^
/data/home/liyueqiao/adv2018/faster-rcnn.pytorch/lib/model/roi_crop/src/roi_crop_cuda.c:68:61: error: dereferencing pointer to incomplete type
gradOutput->size[0],
^
Traceback (most recent call last):
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/unixccompiler.py", line 118, in _compile
extra_postargs)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/command/build_ext.py", line 533, in build_extension
depends=ext.depends)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/ccompiler.py", line 574, in compile
self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/distutils/unixccompiler.py", line 120, in _compile
raise CompileError(msg)
distutils.errors.CompileError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "model/roi_crop/build.py", line 36, in
ffi.build()
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/home/liyueqiao/anaconda3/envs/py3.6/lib/python3.6/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1

as I am not so familiar with gcc, can anyone help?

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@liyueqiao what about your parameters?(anaconda, cuda, gcc(use gcc -v to check it))

@liyueqiao
Copy link

gcc version 4.8.5 (GCC) cuda 8.0.61 conda 4.5.9with python3.6

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@liyueqiao
you use cuda8.0 and are you sure you install the correct version of pytorch with cuda8.0 and py3.6? you can yry to uninstall your current pytorch and install pytorch for another time by
download "cu80/torch-0.4.0-cp36-cp36m-linux_x86_64.whl" from
https://pytorch.org/previous-versions/

and use

pip install torch-0.4.0-cp36-cp36m-linux_x86_64.whl torchvision

to repeat your process

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@liyueqiao and can you show your make.sh file?

@liyueqiao
Copy link

this is my make.sh, I only commented "python build.py" and seperately build them.

#!/usr/bin/env bash

CUDA_PATH=/usr/local/cuda/

export CUDA_PATH=/usr/local/cuda/
export CXXFLAGS="-std=c++11"
export CFLAGS="-std=c99"

export PATH=/usr/local/cuda-8.0/bin${PATH:+:${PATH}}
export CPATH=/usr/local/cuda-8.0/include${CPATH:+:${CPATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-8.0/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

python setup.py build_ext --inplace
rm -rf build

CUDA_ARCH="-gencode arch=compute_30,code=sm_30
-gencode arch=compute_35,code=sm_35
-gencode arch=compute_50,code=sm_50
-gencode arch=compute_52,code=sm_52
-gencode arch=compute_60,code=sm_60
-gencode arch=compute_61,code=sm_61 "
#CUDA_ARCH="-gencode arch=compute_60,code=sm_60"

compile NMS

cd model/nms/src
echo "Compiling nms kernels by nvcc..."
nvcc -c -o nms_cuda_kernel.cu.o nms_cuda_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH

cd ../
#python build.py

compile roi_pooling

cd ../../
cd model/roi_pooling/src
echo "Compiling roi pooling kernels by nvcc..."
nvcc -c -o roi_pooling.cu.o roi_pooling_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
#python build.py

compile roi_align

cd ../../
cd model/roi_align/src
echo "Compiling roi align kernels by nvcc..."
nvcc -c -o roi_align_kernel.cu.o roi_align_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
#python build.py

compile roi_crop

cd ../../
cd model/roi_crop/src
echo "Compiling roi crop kernels by nvcc..."
nvcc -c -o roi_crop_cuda_kernel.cu.o roi_crop_cuda_kernel.cu
-D GOOGLE_CUDA=1 -x cu -Xcompiler -fPIC $CUDA_ARCH
cd ../
#python build.py

@DaVilla7
Copy link
Author

DaVilla7 commented Aug 1, 2018

@liyueqiao ok, I think nothing's wrong with your make.sh file, try it again

@liyueqiao
Copy link

amazing! It works! Thank you sooooooooooooo much!!!!

@ONLY-VEDA
Copy link

@liyueqiao
Origin:
All in all, this issue caused by the incompatible API of newly released pytorch.

In the newer version(>=0.4.1), Broadcast behavior changed in an (very rare) edge case: [1] x [0] now broadcasts to [0] (used to be [1]) #9209
you can find the release notes in here.

Problem:
And, in your error table,it still shows that your pytorch is newer one, so you should completely uninstall your pytorch( please confirm this! )

How to solve:
Just do this:
pip uninstall pytorch (do it twice)

After that, reinstall version<=0.4.0, as @DaVilla7 mentioned above.

@jwyang
Copy link
Owner

jwyang commented Aug 28, 2018

the above issues should have gone. I have adapt the master branch to pytorch-0.4.0, have a try. let me know if there are any issues.

@jwyang jwyang closed this as completed Aug 28, 2018
@DaVilla7
Copy link
Author

@jwyang hi Dr, you mean I try to compile it in the environment of pytorch-0.4.0 or in pytorch-0.4.1?

@jwyang
Copy link
Owner

jwyang commented Aug 28, 2018

please use pytorch-0.4.0.

@DaVilla7
Copy link
Author

@jwyang in pytorch-0.4.0 all is well, by the way, the other configuration are: anaconda(with python3.6) + cuda9.0(GTX1070) + gcc5.5

@jwyang
Copy link
Owner

jwyang commented Aug 28, 2018

great, do you have errors now when using the configuration: python3.6+cuda9.0+gcc5.5?

@DaVilla7
Copy link
Author

@jwyang it's trouble-free up to now, if there are any problems I will illustrate in this issue

@jwyang
Copy link
Owner

jwyang commented Aug 28, 2018

@DaVilla7 very glad to know, cheers!

@YuanEZhou
Copy link

mark.
I solve my problem by:
$ export C_INCLUDE_PATH=${CUDA_HOME}/include:${C_INCLUDE_PATH}
$ export LIBRARY_PATH=${CUDA_HOME}/lib64:$LIBRARY_PATH
$ bash make.sh

@tengshaofeng
Copy link

tengshaofeng commented Dec 12, 2018

@jwyang @ONLY-VEDA if my pytorch version is 0.4.1, and i can not change my version. Do you have other solution?thanks

@jiajialin
Copy link

@tengshaofeng
Check the *.c in lib/model/nms, lib/model/roi_align, lib/model/roi_crop and lib/model/roi_pooling.
Find all the lines like "xxxx->size[x]" or "xxxx->stride[x]"and change them to "THFloatTensor_size(xxxx, x)" or "THFloatTensor_stride(xxxx, x)". It works for me!

@HwaiHo-0552
Copy link

loading gcc5/5.5.0, then it can work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.