ModuleNotFoundError: No module named 'fused_adam_cuda'

[Zhaoxiaolistudy]

hello，ModuleNotFoundError: No module named 'fused_adam_cuda'

linux
pytorch 3.7
cuda9.2

Has been an error：ModuleNotFoundError: No module named 'fused_adam_cuda'。

git clone https://github.com/NVIDIA/apex
$ cd apex
$ pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./

$` pip install -v --no-cache-dir ./

python setup.py install --cuda_ext --cpp_ext

注释掉setup.py中版本检查那段，都试过了，还是有错
Comment out the check of version in setup.py, i've tried everything above, there are still mistakes。 No module named 'fused_adam_cuda'。

[pfZhu]

you can try FusedAdam in apex.optimizers instead of in apex.optimizers.contrib

[dj123jary]

@Zhaoxiaolistudy 我也碰到这个问题了，现在解决了吗？猜测是fused_adam_cuda.cpp文件没有编译成功，但检查了编译过程，没看到这个文件的编译

[dj123jary]

@pfZhu 好像不行，会提示FusedAdam已升级，不建议使用

[pfZhu]

@pfZhu 好像不行，会提示FusedAdam已升级，不建议使用

你是希望用老版本的fp16训练的写法吗？那样的话最好切换apex的commit到之前的版本

[myndtt]

@Zhaoxiaolistudy 我也碰到这个问题了，现在解决了吗？猜测是fused_adam_cuda.cpp文件没有编译成功，但检查了编译过程，没看到这个文件的编译

!python -c 'import importlib;importlib.import_module("fused_adam_cuda")' 确实没有这个库 老哥 现在有解决办法么

[qinkun-210]

我也碰到了这个问题，请问有解决的吗？

[ryotatomioka]

You need to add --deprecated_fused_adam in setup.py or --global-option="--deprecated_fused_adam" in your pip install command.

See:

apex/setup.py

Lines 255 to 272 in a651e2c

	if "--deprecated_fused_adam" in sys.argv:
	from torch.utils.cpp_extension import CUDAExtension
	sys.argv.remove("--deprecated_fused_adam")
	from torch.utils.cpp_extension import BuildExtension
	cmdclass['build_ext'] = BuildExtension
	if torch.utils.cpp_extension.CUDA_HOME is None:
	raise RuntimeError("--deprecated_fused_adam was requested, but nvcc was not found. Are you sure your environment has nvcc available? If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.")
	else:
	ext_modules.append(
	CUDAExtension(name='fused_adam_cuda',
	sources=['apex/contrib/csrc/optimizers/fused_adam_cuda.cpp',
	'apex/contrib/csrc/optimizers/fused_adam_cuda_kernel.cu'],
	include_dirs=[os.path.join(this_dir, 'csrc')],
	extra_compile_args={'cxx': ['-O3',] + version_dependent_macros,
	'nvcc':['-O3',
	'--use_fast_math'] + version_dependent_macros}))

[dajiji]

Niubi. ryotatomioka 的办法 works

[Zhangguoqiang-coder]

you can try FusedAdam in apex.optimizers instead of in apex.optimizers.contrib

在哪里改代码啊