Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

status ==CURAND_STATUS_SUCCESS (201 vs. 0) CURAND_STATUS_LAUNCH_FAILURE #5195

Closed
lawpdas opened this issue Jan 18, 2017 · 6 comments
Closed

Comments

@lawpdas
Copy link

lawpdas commented Jan 18, 2017

I got the following error when making runtest with GTX1080, ubuntu14.04, cuda7.
[----------] 18 tests from RandomNumberGeneratorTest/0, where TypeParam = float [ RUN ] RandomNumberGeneratorTest/0.TestRngGaussian2 [ OK ] RandomNumberGeneratorTest/0.TestRngGaussian2 (0 ms) [ RUN ] RandomNumberGeneratorTest/0.TestRngUniform2 [ OK ] RandomNumberGeneratorTest/0.TestRngUniform2 (1 ms) [ RUN ] RandomNumberGeneratorTest/0.TestRngBernoulli2 [ OK ] RandomNumberGeneratorTest/0.TestRngBernoulli2 (1 ms) [ RUN ] RandomNumberGeneratorTest/0.TestRngGaussianGPU F0118 23:29:34.400086 13613 math_functions.cu:408] Check failed: status == CURAND_STATUS_SUCCESS (201 vs. 0) CURAND_STATUS_LAUNCH_FAILURE *** Check failure stack trace: *** @ 0x2af73c82adaa (unknown) @ 0x2af73c82ace4 (unknown) @ 0x2af73c82a6e6 (unknown) @ 0x2af73c82d687 (unknown) @ 0x2af73e970611 caffe::caffe_gpu_rng_gaussian<>() @ 0x750673 caffe::RandomNumberGeneratorTest_TestRngGaussianGPU_Test<>::TestBody() @ 0x93646a testing::internal::HandleExceptionsInMethodIfSupported<>() @ 0x92bcb9 testing::Test::Run() @ 0x92bd97 testing::TestInfo::Run() @ 0x92bed5 testing::TestCase::Run() @ 0x92c14d testing::internal::UnitTestImpl::RunAllTests() @ 0x935fea testing::internal::HandleExceptionsInMethodIfSupported<>() @ 0x92b511 testing::UnitTest::Run() @ 0x472007 main @ 0x2af73f82bf45 (unknown) @ 0x479c79 (unknown) @ (nil) (unknown) make: *** [runtest] Aborted (core dumped)
I have installed cuda8, but can't solve the problem.

@lawpdas
Copy link
Author

lawpdas commented Jan 19, 2017

I have solved this problem. When I typeldd ./build/tools/caffe | grep cuda, I get

libcudart.so.7.0 => /usr/lib/libcudart.so.7.0 (0x00007f156953f000) 
libcudnn.so.5 => /usr/local/cuda-8.0/lib64/libcudnn.so.5 (0x00007f155bd05000)

Some *.so of cuda7 didn't be removed. After I delete them, everything is fine.

@lawpdas lawpdas closed this as completed Jan 19, 2017
@406747925
Copy link

I also meet 201 vs 0 problem , I also remove libcudart.so.7.0 and compile it again ,but I didn't solve the problem . The log is like this 👍

[ RUN ] NeuronLayerTest/2.TestDropoutThreeQuarters
F1114 20:05:47.307103 32584 math_functions.cu:416] Check failed: status == CURAND_STATUS_SUCCESS (201 vs. 0) CURAND_STATUS_LAUNCH_FAILURE
*** Check failure stack trace: ***
@ 0x7febff5405cd google::LogMessage::Fail()
@ 0x7febff542433 google::LogMessage::SendToLog()
@ 0x7febff54015b google::LogMessage::Flush()
@ 0x7febff542e1e google::LogMessageFatal::~LogMessageFatal()
@ 0x7febf8f8dcfa caffe::caffe_gpu_rng_uniform()
@ 0x7febf8fb5d52 caffe::DropoutLayer<>::Forward_gpu()
@ 0x497019 caffe::Layer<>::Forward()
@ 0x55fd56 caffe::NeuronLayerTest<>::TestDropoutForward()
@ 0x92c053 testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x92566a testing::Test::Run()
@ 0x9257b8 testing::TestInfo::Run()
@ 0x925895 testing::TestCase::Run()
@ 0x926b6f testing::internal::UnitTestImpl::RunAllTests()
@ 0x926e93 testing::UnitTest::Run()
@ 0x46df5d main
@ 0x7febf8154830 __libc_start_main
@ 0x475ab9 _start
@ (nil) (unknown)
Makefile:532: recipe for target 'runtest' failed

does anyone also meet that problem ?

@JimmyLauren
Copy link

@lawpdas thanks a lot, i've solved this problem using your method.

@lawpdas
Copy link
Author

lawpdas commented Jan 17, 2018

Hi, @406747925 ! You can refer to the following issue.

@xiezhongzhao
Copy link

xiezhongzhao commented Apr 6, 2018

@lawpdas when I run ./build/tools/caffe | grep cuda ,I get

        libcudart.so.7.5 => /usr/lib/x86_64-linux-gnu/libcudart.so.7.5 (0x00007f948a9f1000)
	libcudnn.so.6 => /usr/local/cuda/lib64/libcudnn.so.6 (0x00007f9476cc0000)
	libicudata.so.55 => /usr/lib/x86_64-linux-gnu/libicudata.so.55 (0x00007f945f821000)

However, after cuda7.5 was removed, I run make runtest, it happeded as follows:

.build_release/tools/caffe
.build_release/tools/caffe: error while loading shared libraries: libcudart.so.7.5: cannot open shared object file: No such file or directory
Makefile:532: recipe for target 'runtest' failed
make: *** [runtest] Error 127

@Athenaplot
Copy link

I have solved this problem. When I typeldd ./build/tools/caffe | grep cuda, I get

libcudart.so.7.0 => /usr/lib/libcudart.so.7.0 (0x00007f156953f000) 
libcudnn.so.5 => /usr/local/cuda-8.0/lib64/libcudnn.so.5 (0x00007f155bd05000)

Some *.so of cuda7 didn't be removed. After I delete them, everything is fine.

could you please tell me how to remove the *.so of cuda7. which command should I use.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants