Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

profiler failure on multi-gpu (works on single GPU #9052

Closed
panyx0718 opened this issue Mar 14, 2018 · 0 comments
Closed

profiler failure on multi-gpu (works on single GPU #9052

panyx0718 opened this issue Mar 14, 2018 · 0 comments

Comments

@panyx0718
Copy link
Contributor

reproduced in PR: #9051

this line:
"PADDLE_ENFORCE(cudaEventRecord(event_, stream));"

terminate called after throwing an instance of 'paddle::platform::EnforceNotMet'
what(): invalid resource handle at [/paddle/dev/my/Paddle3/paddle/fluid/platform/profiler.cc:73]
PaddlePaddle Call Stacks:
0 0x7f21a215138cp paddle::platform::EnforceNotMet::EnforceNotMet(std::__exception_ptr::exception_ptr, char const*, int) + 572
1 0x7f21a220e66dp paddle::platform::Event::Event(paddle::platform::EventKind, std::__cxx11::basic_string<char, std::char_traits, std::allocator >, unsigned int, paddle::platform::DeviceContext const*) + 317
2 0x7f21a220f316p paddle::platform::PopEvent(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, paddle::platform::DeviceContext const*) + 246
3 0x7f21a220f943p paddle::platform::RecordEvent::~RecordEvent() + 211
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@panyx0718