Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error with install apex #808

Open
ChenZhounan opened this issue Apr 27, 2020 · 4 comments
Open

Error with install apex #808

ChenZhounan opened this issue Apr 27, 2020 · 4 comments

Comments

@ChenZhounan
Copy link

ChenZhounan commented Apr 27, 2020

I get this error installing with“python setup.py install --user --cuda_ext --cpp_ext”. Please advise! Thank you!

torch.version = 1.3.1
running install
running bdist_egg
running egg_info
creating apex.egg-info
writing apex.egg-info/PKG-INFO
writing dependency_links to apex.egg-info/dependency_links.txt
writing top-level names to apex.egg-info/top_level.txt
writing manifest file 'apex.egg-info/SOURCES.txt'
reading manifest file 'apex.egg-info/SOURCES.txt'
writing manifest file 'apex.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-x86_64-3.6
creating build/lib.linux-x86_64-3.6/apex
copying apex/init.py -> build/lib.linux-x86_64-3.6/apex
creating build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/optimized_sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/LARC.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/init.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/multiproc.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/distributed.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/optimized_sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
creating build/lib.linux-x86_64-3.6/apex/normalization
copying apex/normalization/init.py -> build/lib.linux-x86_64-3.6/apex/normalization
copying apex/normalization/fused_layer_norm.py -> build/lib.linux-x86_64-3.6/apex/normalization
creating build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/RNNBackend.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/models.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/init.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/cells.py -> build/lib.linux-x86_64-3.6/apex/RNN
creating build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/init.py -> build/lib.linux-x86_64-3.6/apex/optimizers
creating build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/loss_scaler.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/init.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/fp16util.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
creating build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/reparameterization.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/weight_norm.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/init.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
creating build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/rnn_compat.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/version.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/utils.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/scaler.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/handle.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/wrap.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/opt.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/init.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/compat.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/amp.py -> build/lib.linux-x86_64-3.6/apex/amp
creating build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/functional_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/torch_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/tensor_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/init.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
running build_ext
building 'apex_C' extension
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/csrc
gcc -pthread -B /home/czn/anaconda3/envs/layoutlm/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/TH -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/THC -I/home/czn/anaconda3/envs/layoutlm/include/python3.6m -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11

cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
g++ -pthread -shared -B /home/czn/anaconda3/envs/layoutlm/compiler_compat -L/home/czn/anaconda3/envs/layoutlm/lib -Wl,-rpath=/home/czn/anaconda3/envs/layoutlm/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -o build/lib.linux-x86_64-3.6/apex_C.cpython-36m-x86_64-linux-gnu.so
building 'amp_C' extension
gcc -pthread -B /home/czn/anaconda3/envs/layoutlm/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/TH -I/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/THC -I/home/czn/cuda-10.0/include -I/home/czn/anaconda3/envs/layoutlm/include/python3.6m -c csrc/scale_check_overflow.cpp -o build/temp.linux-x86_64-3.6/csrc/scale_check_overflow.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++

In file included from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Device.h:5:0,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
from csrc/scale_check_overflow.cpp:1:
csrc/scale_check_overflow.cpp: In function ‘void scale_check_overflow(at::Tensor, float, at::Tensor, at::Tensor)’:
/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:350:20: warning: ‘void c10::detail::deprecated_AT_CHECK()’ is deprecated [-Wdeprecated-declarations]
::c10::detail::deprecated_AT_CHECK();
^
csrc/scale_check_overflow.cpp:14:3: note: in expansion of macro ‘AT_CHECK’
AT_CHECK(grads.type().is_cuda(), "grads must be a CUDA tensor");
^

In file included from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Device.h:5:0,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
from csrc/scale_check_overflow.cpp:1:
/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:325:13: note: declared here
inline void deprecated_AT_CHECK() {}
^~~~~~~~~~~~~~~~~~~
……
In file included from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Device.h:5:0,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
from /home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
from csrc/scale_check_overflow.cpp:1:
/home/czn/anaconda3/envs/layoutlm/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:349:3: error: expected ‘;’ before ‘do’
do {
^
error: command 'gcc' failed with exit status 1

my python and pytorch version:
Python 3.6.10 |Anaconda, Inc.| (default, Mar 25 2020, 23:51:54) '1.3.1'

my nvcc --version:
Cuda compilation tools, release 10.0, V10.0.130

my gcc --version:
gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0

@V-Enzo
Copy link

V-Enzo commented Aug 10, 2020

Hi, I have met the same problem. Have you solved it? @ChenZhounan

@ChenZhounan
Copy link
Author

I followed the intruction in #802 (comment) to rollback to an earlier version of apex and have solved it.

@ChenZhounan
Copy link
Author

@V-Enzo

@V-Enzo
Copy link

V-Enzo commented Aug 21, 2020

OK Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants