Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_multihead_attention fails #9365

Closed
luotao1 opened this issue Mar 26, 2018 · 0 comments
Closed

test_multihead_attention fails #9365

luotao1 opened this issue Mar 26, 2018 · 0 comments

Comments

@luotao1
Copy link
Contributor

luotao1 commented Mar 26, 2018

#9359 only fix typo, but unit test of Teamcity fails:
https://paddleci.ngrok.io/viewLog.html?buildId=31543&buildTypeId=Paddle_PrCi&tab=buildLog&_focus=11644

[11:01:33]	188/215 Test #185: test_multihead_attention ........................***Failed    3.97 sec
[11:01:33]	test_multihead_attention (test_multihead_attention.TestMultiheadAttention) ... ERROR
[11:01:33]	
[11:01:33]	======================================================================
[11:01:33]	ERROR: test_multihead_attention (test_multihead_attention.TestMultiheadAttention)
[11:01:33]	----------------------------------------------------------------------
[11:01:33]	Traceback (most recent call last):
[11:01:33]	  File "test_multihead_attention.py", line 92, in test_multihead_attention
[11:01:33]	    self.run_program()
[11:01:33]	  File "test_multihead_attention.py", line 65, in run_program
[11:01:33]	    self.set_inputs(place)
[11:01:33]	  File "test_multihead_attention.py", line 80, in set_inputs
[11:01:33]	    queries.set(self.queries, place)
[11:01:33]	EnforceNotMet: enforce allocating <= available failed, 1822361026 > 1771896576
[11:01:33]	 at [/paddle/paddle/fluid/platform/gpu_info.cc:118]
[11:01:33]	PaddlePaddle Call Stacks: 
[11:01:33]	0       0x7ff91a6f26e8p paddle::platform::GpuMaxChunkSize() + 5080
[11:01:33]	1       0x7ff91999cfc9p paddle::memory::GetGPUBuddyAllocator(int) + 249
[11:01:33]	2       0x7ff91999d19bp void* paddle::memory::Alloc<paddle::platform::CUDAPlace>(paddle::platform::CUDAPlace, unsigned long) + 43
[11:01:33]	3       0x7ff9198f74e2p paddle::framework::Tensor::mutable_data(boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_>, std::type_index) + 674
[11:01:33]	4       0x7ff91992d81ap void paddle::pybind::PyCUDATensorSetFromArray<float>(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&) + 330
[11:01:33]	5       0x7ff91990f345p void pybind11::detail::argument_loader<paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&>::call_impl<void, void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), 0ul, 1ul, 2ul>(void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), pybind11::detail::index_sequence<0ul, 1ul, 2ul>) + 85
[11:01:33]	6       0x7ff919917f35p void pybind11::cpp_function::initialize<void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), void, paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&, pybind11::name, pybind11::is_method, pybind11::sibling>(void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), void (*)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&)::{lambda(pybind11::detail::function_call&)#3}::operator()(pybind11::detail::function_call&) const + 517
[11:01:33]	7       0x7ff9199180bep void pybind11::cpp_function::initialize<void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), void, paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&, pybind11::name, pybind11::is_method, pybind11::sibling>(void (*&)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), void (*)(paddle::framework::Tensor&, pybind11::array_t<float, 17>, paddle::platform::CUDAPlace&), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&)::{lambda(pybind11::detail::function_call&)#3}::_FUN(pybind11::detail::function_call&) + 14
[11:01:33]	8       0x7ff91990c0a4p pybind11::cpp_function::dispatcher(_object*, _object*, _object*) + 1236
[11:01:33]	9             0x4c37edp PyEval_EvalFrameEx + 31165
[11:01:33]	10            0x4c136fp PyEval_EvalFrameEx + 21823
[11:01:33]	11            0x4c136fp PyEval_EvalFrameEx + 21823
[11:01:33]	12            0x4c136fp PyEval_EvalFrameEx + 21823
[11:01:33]	13            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	14            0x4d55f3p
[11:01:33]	15            0x4a577ep PyObject_Call + 62
[11:01:33]	16            0x4bed3dp PyEval_EvalFrameEx + 12045
[11:01:33]	17            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	18            0x4d54b9p
[11:01:33]	19            0x4eebeep
[11:01:33]	20            0x4a577ep PyObject_Call + 62
[11:01:33]	21            0x548253p
[11:01:33]	22            0x4c15bfp PyEval_EvalFrameEx + 22415
[11:01:33]	23            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	24            0x4d55f3p
[11:01:33]	25            0x4a577ep PyObject_Call + 62
[11:01:33]	26            0x4bed3dp PyEval_EvalFrameEx + 12045
[11:01:33]	27            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	28            0x4d54b9p
[11:01:33]	29            0x4eebeep
[11:01:33]	30            0x4a577ep PyObject_Call + 62
[11:01:33]	31            0x548253p
[11:01:33]	32            0x4c15bfp PyEval_EvalFrameEx + 22415
[11:01:33]	33            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	34            0x4d55f3p
[11:01:33]	35            0x4a577ep PyObject_Call + 62
[11:01:33]	36            0x4bed3dp PyEval_EvalFrameEx + 12045
[11:01:33]	37            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	38            0x4d54b9p
[11:01:33]	39            0x4eebeep
[11:01:33]	40            0x4a577ep PyObject_Call + 62
[11:01:33]	41            0x548253p
[11:01:33]	42            0x4c15bfp PyEval_EvalFrameEx + 22415
[11:01:33]	43            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	44            0x4d55f3p
[11:01:33]	45            0x4a577ep PyObject_Call + 62
[11:01:33]	46            0x4bed3dp PyEval_EvalFrameEx + 12045
[11:01:33]	47            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	48            0x4d54b9p
[11:01:33]	49            0x4eebeep
[11:01:33]	50            0x4a577ep PyObject_Call + 62
[11:01:33]	51            0x548253p
[11:01:33]	52            0x4c15bfp PyEval_EvalFrameEx + 22415
[11:01:33]	53            0x4c136fp PyEval_EvalFrameEx + 21823
[11:01:33]	54            0x4c136fp PyEval_EvalFrameEx + 21823
[11:01:33]	55            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	56            0x4d55f3p
[11:01:33]	57            0x4eebeep
[11:01:33]	58            0x4ee7f6p
[11:01:33]	59            0x4aa9abp
[11:01:33]	60            0x4c15bfp PyEval_EvalFrameEx + 22415
[11:01:33]	61            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	62            0x4bfa8dp PyEval_EvalFrameEx + 15453
[11:01:33]	63            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	64            0x4c16e7p PyEval_EvalFrameEx + 22711
[11:01:33]	65            0x4b9ab6p PyEval_EvalCodeEx + 774
[11:01:33]	66            0x4d54b9p
[11:01:33]	67            0x4a577ep PyObject_Call + 62
[11:01:33]	68            0x519a46p
[11:01:33]	69            0x493b06p Py_Main + 1590
[11:01:33]	70      0x7ff9ab4c8830p __libc_start_main + 240
[11:01:33]	71            0x4933e9p _start + 41
[11:01:33]	
[11:01:33]	
[11:01:33]	----------------------------------------------------------------------
[11:01:33]	Ran 1 test in 0.070s
[11:01:33]	
[11:01:33]	FAILED (errors=1)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant