Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_DataParallelTable Failed #289

Closed
shuni1001 opened this issue Jun 4, 2016 · 3 comments
Closed

test_DataParallelTable Failed #289

shuni1001 opened this issue Jun 4, 2016 · 3 comments

Comments

@shuni1001
Copy link

failed

Hello.

In my machine which has two GTX1080, test_DataParallelTable.lua is failed.
I reinstall the whole torch packages but still there are same problems.

Here is my configurations:
2 * GTX 1080
CUDA 8.0 RC (Because I have 1080 and its architecture is PASCAL, I heard that CUDA-8.0 is the only cuda version that support PASCAL architecture)
Driver version: 367.18 (The only choice for GTX 1080)
OS Ubuntu 14.04

Could you give me a advice to resolve this error?

@albanD
Copy link
Contributor

albanD commented Jun 4, 2016

Hi,
can you try to reintall cutorch and cunn with:

CUDA_ARCH_BIN=6.1 luarocks install cutorch
luarocks install cunn

and during the installation can you make sure that you get at the beginning of the cutorch installation a line similar to:

Compiling for CUDA architecture: 6.1 6.1

@shuni1001
Copy link
Author

shuni1001 commented Jun 4, 2016

Thank you albanD.

I solved this problem from your reply.
The problem was not related cutorch or cunn. It was nccl.

From your reply, I check the Makefile the nccl, and there is option "NVCC_GENCODE".
As default option, there isn't compute_61 and code=sm_61
So I modified Makefile as below.

NVCC_GENCODE ?= -gencode=arch=compute_35,code=sm_35
-gencode=arch=compute_50,code=sm_50
-gencode=arch=compute_52,code=sm_52
-gencode=arch=compute_61,code=sm_61

And it works.
The problem was solved.
Thank you.

@borisfom
Copy link
Contributor

borisfom commented Jun 6, 2016

Fixed in last release:

I have published updated versions of both 7.5 and 8.0 packages for NCCL:
https://github.com/NVIDIA/nccl/releases/tag/v1.2.2-1%2Bcuda8.0
https://github.com/NVIDIA/nccl/releases/tag/v1.2.2-1%2Bcuda7.5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants