Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory leak (core dumped) problem in tfjs-node #8284

Open
Hyodori04 opened this issue May 24, 2024 · 4 comments
Open

memory leak (core dumped) problem in tfjs-node #8284

Hyodori04 opened this issue May 24, 2024 · 4 comments
Assignees
Labels
comp:node.js type:bug Something isn't working

Comments

@Hyodori04
Copy link

Hyodori04 commented May 24, 2024

System information

  • Have I written custom code (as opposed to using a stock example script provided in TensorFlow.js): Never
  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Debian GNU/Linux 12 (bookworm)
  • TensorFlow.js installed from (npm or script link): yarn-4.2.2
  • TensorFlow.js version (use command below): 4.19
  • Browser version: we use tfjs-node
  • Tensorflow.js Converter Version: 4.18

Describe the current behavior

We serve our service in docker node.
If there are several sequential requests that use model.predict, our node server is killed
I think there is some kind of memory leak because error logs are like
And docker metrics have similar memory size

  1. free(): invalid size
    Aborted (core dumped)

  2. segmentation fault (core dumped)
  3. corrupted size vs. prev_size (core dumped)

Describe the expected behavior

Memory leak error doesn't happen

Standalone code to reproduce the issue
Provide a reproducible test case that is the bare minimum necessary to generate
the problem. If possible, please share a link to Colab/CodePen/any notebook.

interface GetImageAnimalInfo {
  model: tf.GraphModel;
  arrayBuffer: ArrayBuffer;
  mutex: Mutex;
}

export const getImageAnimalInfo = async ({
  model,
  arrayBuffer,
  mutex,
}: GetImageAnimalInfo) => {
  const release = await mutex.acquire();

  try {
    const prediction = tf.tidy(() => {
      const uint8Array = new Uint8Array(arrayBuffer);

      const inputTensor = tf.node
        .decodeImage(uint8Array, IMAGE_DECODE_CHANNEL)
        .resizeNearestNeighbor([RESIZE_DIMENSION, RESIZE_DIMENSION])
        .toFloat();

      const input = inputTensor.div(tf.scalar(SCALAR)).expandDims(0);

      return model.predict(input) as tf.Tensor;
    });

    const result = await prediction.data();
    prediction.dispose();

    return result;
  } catch (err) {
    logger.error(err);
    return [];
  } finally {
    release();
  }
};

Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.

And other problem is some version services do not make error
We test using same tool called charles
We use same CD to deploy and same os because we use same docker

We have checked some versions like gcc, python, package.json and they are same

If there is some things to check, comment it and we can give more infomation

@Hyodori04 Hyodori04 added the type:bug Something isn't working label May 24, 2024
@gaikwadrahul8 gaikwadrahul8 self-assigned this May 27, 2024
@gaikwadrahul8
Copy link
Contributor

Hi, @Hyodori04

I apologize for the delayed response and thank you for bringing this issue to our attention, if possible could you please help us with your Github repo along with complete steps to replicate the same behavior from our end to investigate this issue further from our end ?

Thank you from your cooperation and patience.

@Hyodori04
Copy link
Author

Hi @gaikwadrahul8

We serve our serivce as product. So it's hard to share Github repo that provide a reproducible code. Is there any other way to help?

@Hyodori04
Copy link
Author

Hi, I bring core dump gdb backtrace

(gdb) backtrace
#0  __pthread_kill_implementation (threadid=<optimized out>, signo=signo@entry=6, no_tid=no_tid@entry=0) at ./nptl/pthread_kill.c:44
#1  0x00007f1d670c5e8f in __pthread_kill_internal (signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:78
#2  0x00007f1d67076fb2 in __GI_raise (sig=sig@entry=6) at ../sysdeps/posix/raise.c:26
#3  0x00007f1d67061472 in __GI_abort () at ./stdlib/abort.c:79
#4  0x00007f1d670ba430 in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7f1d671d4459 "%s\n") at ../sysdeps/posix/libc_fatal.c:155
#5  0x00007f1d670cf7aa in malloc_printerr (str=str@entry=0x7f1d671d71a8 "corrupted size vs. prev_size while consolidating") at ./malloc/malloc.c:5660
#6  0x00007f1d670d18a8 in _int_free (av=0x7f1d6720dc60 <main_arena>, p=0x9c7dbb0, have_lock=<optimized out>, have_lock@entry=0) at ./malloc/malloc.c:4602
#7  0x00007f1d670d3e8f in __GI___libc_free (mem=<optimized out>) at ./malloc/malloc.c:3385
#8  0x00007f1811cfa269 in dnnl::impl::cpu::x64::avx512_common_gemm_f32::sgemm_nocopy_driver(char const*, char const*, long, long, long, float const*, float const*, long, float const*, long, float const*, float*, long, float const*) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#9  0x00007f1811cfa9ca in dnnl::impl::cpu::x64::jit_avx512_common_gemm_f32(int, char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, long const*, float const*, float*, long const*, float const*) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#10 0x00007f1811e8dd15 in dnnl_status_t dnnl::impl::cpu::x64::gemm_driver<float, float, float>(char const*, char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, float const*, long const*, float const*, float const*, float*, long const*, float const*, bool, dnnl::impl::cpu::x64::pack_type, dnnl::impl::cpu::x64::gemm_pack_storage_t*, bool) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#11 0x00007f18119eae2c in dnnl::impl::cpu::extended_sgemm(char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, long const*, float const*, float*, long const*, float const*, bool) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#12 0x00007f181163c473 in dnnl_sgemm () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#13 0x00007f180e346161 in Eigen::internal::TensorContractionKernel<float, float, float, long, Eigen::internal::blas_data_mapper<float, long, 0, 0, 1>, Eigen::internal::TensorContractionInputMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 8, true, false, 0, Eigen::MakePointer>, Eigen::internal::TensorContractionInputMapper<float, long, 0, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 8, true, false, 0, Eigen::MakePointer> >::invoke(Eigen::internal::blas_data_mapper<float, long, 0, 0, 1> const&, Eigen::internal::ColMajorBlock<float, long> const&, Eigen::internal::ColMajorBlock<float, long> const&, long, long, long, float, float) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#14 0x00007f180e350095 in Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::kernel(long, long, long, bool) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#15 0x00007f180e351f4c in Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::pack_rhs(long, long) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#16 0x00007f180e352591 in Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::enqueue_packing_helper(long, long, long, bool) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#17 0x00007f180e352558 in Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, --Type <RET> for more, q to quit, c to continue without paging--
long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::enqueue_packing_helper(long, long, long, bool) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#18 0x00007f180e36afdb in void Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::evalProductImpl<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, 0>(float*, Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback) const () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#19 0x00007f180e36bf01 in Eigen::internal::TensorExecutor<Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<float, 2, 1, long>, 16, Eigen::MakePointer>, Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const> const, Eigen::ThreadPoolDevice, true, (Eigen::internal::TiledEvaluation)0>::run(Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<float, 2, 1, long>, 16, Eigen::MakePointer>, Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const> const&, Eigen::ThreadPoolDevice const&) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#20 0x00007f1810b54bc0 in tensorflow::(anonymous namespace)::LaunchGeneric<Eigen::ThreadPoolDevice, float>::operator()(tensorflow::OpKernelContext*, tensorflow::Tensor const&, tensorflow::Tensor const&, int, int, int, int, tensorflow::Padding const&, std::vector<long, std::allocator<long> > const&, tensorflow::Tensor*, tensorflow::TensorFormat) [clone .isra.0] [clone .constprop.0] () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#21 0x00007f1810b54e01 in tensorflow::LaunchConv2DOp<Eigen::ThreadPoolDevice, float>::operator()(tensorflow::OpKernelContext*, bool, bool, tensorflow::Tensor const&, tensorflow::Tensor const&, int, int, int, int, tensorflow::Padding const&, std::vector<long, std::allocator<long> > const&, tensorflow::Tensor*, tensorflow::TensorFormat) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#22 0x00007f1810b55d3f in tensorflow::Conv2DOp<Eigen::ThreadPoolDevice, float>::Compute(tensorflow::OpKernelContext*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#23 0x00007f1806d7ffbb in tensorflow::ThreadPoolDevice::Compute(tensorflow::OpKernel*, tensorflow::OpKernelContext*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow_framework.so.2
#24 0x00007f180cce9187 in tensorflow::KernelAndDeviceOp::Run(tensorflow::ScopedStepContainer*, tensorflow::EagerKernelArgs const&, std::vector<absl::lts_20211102::variant<tensorflow::Tensor, tensorflow::TensorShape>, std::allocator<absl::lts_20211102::variant<tensorflow::Tensor, tensorflow::TensorShape> > >*, tensorflow::CancellationManager*, absl::lts_20211102::optional<tensorflow::EagerFunctionParams> const&, absl::lts_20211102::optional<tensorflow::ManagedStackTrace> const&, tensorflow::CoordinationServiceAgent*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#25 0x00007f180cc997c9 in tensorflow::EagerKernelExecute(tensorflow::EagerContext*, absl::lts_20211102::InlinedVector<tensorflow::TensorHandle*, 4ul, std::allocator<tensorflow::TensorHandle*> > const&, absl::lts_20211102::optional<tensorflow::EagerFunctionParams> const&, std::unique_ptr<tensorflow::KernelAndDevice, tensorflow::core::RefCountDeleter> const&, tensorflow::GraphCollector*, tensorflow::CancellationManager*, absl::lts_20211102::Span<tensorflow::TensorHandle*>, absl::lts_20211102::optional<tensorflow::ManagedStackTrace> const&) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#26 0x00007f180cc9ab89 in tensorflow::ExecuteNode::Run() () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#27 0x00007f180cce0d50 in tensorflow::EagerExecutor::SyncExecute(tensorflow::EagerNode*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#28 0x00007f180cc94c46 in tensorflow::(anonymous namespace)::EagerLocalExecute(tensorflow::EagerOperation*, tensorflow::TensorHandle**, int*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#29 0x00007f180cc952b4 in tensorflow::EagerExecute(tensorflow::EagerOperation*, tensorflow::TensorHandle**, int*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#30 0x00007f180b076ae0 in tensorflow::EagerOperation::Execute(absl::lts_20211102::Span<tensorflow::AbstractTensorHandle*>, int*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
--Type <RET> for more, q to quit, c to continue without paging--
#31 0x00007f180ccf544a in tensorflow::CustomDeviceOpHandler::Execute(tensorflow::ImmediateExecutionOperation*, tensorflow::ImmediateExecutionTensorHandle**, int*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#32 0x00007f1808d4f9f6 in TFE_Execute () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/../../deps/lib/libtensorflow.so.2
#33 0x00007f1d6477ffcb in tfnodejs::TFJSBackend::ExecuteOp(napi_env__*, napi_value__*, napi_value__*, napi_value__*, napi_value__*) ()
   from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/tfjs_binding.node
#34 0x00007f1d647835f0 in tfnodejs::ExecuteOp(napi_env__*, napi_callback_info__*) () from /node_modules/@tensorflow/tfjs-node/lib/napi-v8/tfjs_binding.node
#35 0x0000000000c51049 in v8impl::(anonymous namespace)::FunctionCallbackWrapper::Invoke(v8::FunctionCallbackInfo<v8::Value> const&) ()
#36 0x0000000000f0c81c in v8::internal::InvokeFunctionCallback(v8::FunctionCallbackInfo<v8::Value> const&, void (*)(v8::FunctionCallbackInfo<v8::Value> const&)) ()
#37 0x00000000018d759d in Builtins_CallApiCallback ()
#38 0x00007ffefeda8718 in ?? ()
#39 0x00007ffefeda8750 in ?? ()
#40 0x0000000000000004 in ?? ()
#41 0x0000000000000058 in ?? ()
#42 0x00007f1d3f954227 in ?? ()
#43 0x00007ffefeda86d0 in ?? ()
#44 0x0000000000000006 in ?? ()
#45 0x00007ffefeda87d0 in ?? ()
#46 0x00007f1d3f891ffc in ?? ()
#47 0x00000925ccbd01c9 in ?? ()
#48 0x00000000069fd430 in ?? ()
#49 0x00000177d27804e9 in ?? ()
#50 0x00000177d27804e9 in ?? ()
#51 0x0000321439cd64e1 in ?? ()
#52 0x00000177d27804e9 in ?? ()
#53 0x00000925ccbd01c9 in ?? ()
#54 0x00001281ec7e0a39 in ?? ()
#55 0x00002b44b5e664b1 in ?? ()
#56 0x00002b44b5e666f1 in ?? ()
#57 0x0000000100000000 in ?? ()
#58 0x0000000000000001 in ?? ()
#59 0x000015a44d367291 in ?? ()
#60 0x0000000000000001 in ?? ()
#61 0x000021b990e555e1 in ?? ()
#62 0x0000000000000002 in ?? ()
#63 0x00002b44b5e666f1 in ?? ()
#64 0x00000925ccbd01c9 in ?? ()
#65 0x000007e664b26e31 in ?? ()
#66 0x00000925ccbd2769 in ?? ()
#67 0x0000000000000004 in ?? ()
#68 0x0000033fb8912259 in ?? ()
#69 0x00000925ccbd2769 in ?? ()
#70 0x00007ffefeda8898 in ?? ()
#71 0x00007f1d3f8138d0 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#72 0x000005a13da86be9 in ?? ()
#73 0x00001281ec7e0a39 in ?? ()
#74 0x00002b44b5e664b1 in ?? ()
#75 0x00002b44b5e666c1 in ?? ()
#76 0x00000177d27804e9 in ?? ()
#77 0x00000177d27804e9 in ?? ()
#78 0x0000000100000000 in ?? ()
#79 0x00002b44b5e666c1 in ?? ()
#80 0x00002b44b5e664b1 in ?? ()
#81 0x00001281ec7e0a39 in ?? ()
#82 0x000005a13da86be9 in ?? ()
#83 0x0000033fb8912259 in ?? ()
#84 0x00000177d27804e9 in ?? ()
#85 0x00002b44b5e664b1 in ?? ()
#86 0x00002b44b5e66481 in ?? ()
#87 0x00003e99f53aa601 in ?? ()
#88 0x00000e58df571a01 in ?? ()
#89 0x00002b44b5e66421 in ?? ()
#90 0x000025248c1c5a49 in ?? ()
#91 0x00001d55330be619 in ?? ()
#92 0x0000000000000005 in ?? ()
#93 0x0000321439cf03e9 in ?? ()
#94 0x0000321439cef459 in ?? ()
#95 0x00007ffefeda89e0 in ?? ()
#96 0x00007f1d3f810e07 in ?? ()
#97 0x00000177d27804e9 in ?? ()
#98 0x00002b44b5e61329 in ?? ()
#99 0x000021b990e55621 in ?? ()
#100 0x00002b44b5e66329 in ?? ()
#101 0x000005a13da86be9 in ?? ()
#102 0x00003beda42f10e9 in ?? ()
#103 0x00000177d27806b9 in ?? ()
#104 0x00000177d27804e9 in ?? ()
#105 0x000021b990e7f211 in ?? ()
#106 0x00002b44b5e63439 in ?? ()
#107 0x000005a13da86be9 in ?? ()
#108 0x00002b44b5e66329 in ?? ()
#109 0x000021b990e55621 in ?? ()
#110 0x00002b44b5e61329 in ?? ()
#111 0x0000321439cf03e9 in ?? ()
#112 0x00000177d27804e9 in ?? ()
#113 0x00000177d27804e9 in ?? ()
#114 0x00000177d27804e9 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#115 0x00002b44b5e66329 in ?? ()
#116 0x00003beda42f10e9 in ?? ()
#117 0x00002b44b5e63871 in ?? ()
#118 0x000021b990e44ba9 in ?? ()
#119 0x00000177d27804e9 in ?? ()
#120 0x00002b44b5e63439 in ?? ()
#121 0x00002b44b5e62939 in ?? ()
#122 0x000021b990e7f211 in ?? ()
#123 0x00002b44b5e633e9 in ?? ()
#124 0x00002b44b5e64819 in ?? ()
#125 0x000005a13da86be9 in ?? ()
#126 0x00000177d27804e9 in ?? ()
#127 0x000021b990e558b9 in ?? ()
#128 0x000021b990e55621 in ?? ()
#129 0x00002b44b5e61329 in ?? ()
#130 0x00002b44b5e647d1 in ?? ()
#131 0x00001f6df86d1ab1 in ?? ()
#132 0x00000e58df56c549 in ?? ()
#133 0x0000000000000002 in ?? ()
#134 0x0000321439cec859 in ?? ()
#135 0x0000321439cefa09 in ?? ()
#136 0x00007ffefeda8a60 in ?? ()
#137 0x00007f1d3f97161f in ?? ()
#138 0x00000925ccbff231 in ?? ()
#139 0x00002b44b5e65a21 in ?? ()
#140 0x000013e8c5dc11c1 in ?? ()
#141 0x00007ffefeda8a58 in ?? ()
#142 0x00007f1d3f77e008 in ?? ()
#143 0x00001f242158cfb1 in ?? ()
#144 0x00007f1d3f77e008 in ?? ()
#145 0x000035da9aa63b21 in ?? ()
#146 0x0000007700000000 in ?? ()
#147 0x00002b44b5e657b1 in ?? ()
#148 0x00002b44b5e65921 in ?? ()
#149 0x0000000000000001 in ?? ()
#150 0x00002b44b5e65921 in ?? ()
#151 0x00002b44b5e657b1 in ?? ()
#152 0x00007ffefeda8ac8 in ?? ()
#153 0x00007f1d3f807a67 in ?? ()
#154 0x00000177d27804e9 in ?? ()
#155 0x00000177d27804e9 in ?? ()
#156 0x00000177d27804e9 in ?? ()
#157 0x000031215493a6d1 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#158 0x00001f242158cfb1 in ?? ()
#159 0x00002b44b5e65921 in ?? ()
#160 0x000005e047707e89 in ?? ()
#161 0x000028d1ffe251d1 in ?? ()
#162 0x0000000000000001 in ?? ()
#163 0x00002b44b5e659e1 in ?? ()
#164 0x00002b44b5e657b1 in ?? ()
#165 0x00007ffefeda8b20 in ?? ()
#166 0x00007f1d3f78eacf in ?? ()
#167 0x00000177d27804e9 in ?? ()
#168 0x00000177d27804e9 in ?? ()
#169 0x000013e8c5dcf011 in ?? ()
#170 0x00000177d27804e9 in ?? ()
#171 0x0000215cd87092e1 in ?? ()
#172 0x000028d1ffe1dc21 in ?? ()
#173 0x0000000000000004 in ?? ()
#174 0x000035da9aa6c019 in ?? ()
#175 0x000013e8c5dcf011 in ?? ()
#176 0x00007ffefeda8be0 in ?? ()
#177 0x00007f1d3f803aac in ?? ()
#178 0x000013e8c5dcfd51 in ?? ()
#179 0x00002b44b5e65961 in ?? ()
#180 0x00002b44b5e659a1 in ?? ()
#181 0x00002b44b5e659e1 in ?? ()
#182 0x00000177d27804e9 in ?? ()
#183 0x00000177d27804e9 in ?? ()
#184 0x00000177d27804e9 in ?? ()
#185 0x00002b44b5e659e1 in ?? ()
#186 0x00002b44b5e659a1 in ?? ()
#187 0x00002b44b5e65961 in ?? ()
#188 0x000013e8c5dcfd51 in ?? ()
#189 0x000035da9aa6c019 in ?? ()
#190 0x000013e8c5dcf011 in ?? ()
#191 0x00000177d2780269 in ?? ()
#192 0x00002b44b5e64819 in ?? ()
#193 0x0000007700000000 in ?? ()
#194 0x01632d1c00000000 in ?? ()
#195 0x000005e04770c5d9 in ?? ()
#196 0x000028d1ffe246a1 in ?? ()
#197 0x0000000000000002 in ?? ()
#198 0x000035da9aa6c1d9 in ?? ()
#199 0x00002b44b5e657b1 in ?? ()
#200 0x00007ffefeda8c60 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#201 0x00007f1d3f804f41 in ?? ()
#202 0x000013e8c5dcfd51 in ?? ()
#203 0x00002b44b5e65771 in ?? ()
#204 0x00000177d27804e9 in ?? ()
#205 0x00000177d27804e9 in ?? ()
#206 0x00000177d27804e9 in ?? ()
#207 0x00002b44b5e65771 in ?? ()
#208 0x00000177d27804e9 in ?? ()
#209 0x000035da9aa6c1d9 in ?? ()
#210 0x00000177d2780659 in ?? ()
#211 0x000005e04770cd61 in ?? ()
#212 0x000028d1ffe23941 in ?? ()
#213 0x0000000000000004 in ?? ()
#214 0x000035da9aa6c119 in ?? ()
#215 0x000013e8c5dcf011 in ?? ()
#216 0x00007ffefeda8ce8 in ?? ()
#217 0x00007f1d3f815297 in ?? ()
#218 0x000013e8c5dcfd51 in ?? ()
#219 0x00001281ec7e1aa9 in ?? ()
#220 0x00002b44b5e647d1 in ?? ()
#221 0x00002b44b5e64819 in ?? ()
#222 0x00002b44b5e64819 in ?? ()
#223 0x00002b44b5e647d1 in ?? ()
#224 0x00001281ec7e1aa9 in ?? ()
#225 0x000013e8c5dcfd51 in ?? ()
#226 0x000035da9aa6c119 in ?? ()
#227 0x00000177d27804e9 in ?? ()
#228 0x000025248c1c6409 in ?? ()
#229 0x00003e99f5386999 in ?? ()
#230 0x0000000000000005 in ?? ()
#231 0x00002b44b5e64879 in ?? ()
#232 0x00002b44b5e637d9 in ?? ()
#233 0x00007ffefeda8da0 in ?? ()
#234 0x00007f1d3f80d45f in ?? ()
#235 0x00000177d27804e9 in ?? ()
#236 0x00002b44b5e61329 in ?? ()
#237 0x000021b990e55621 in ?? ()
#238 0x000021b990e558b9 in ?? ()
#239 0x00002b44b5e64dc9 in ?? ()
#240 0x00000177d27806b9 in ?? ()
#241 0x00000177d27806b9 in ?? ()
#242 0x00002b44b5e65371 in ?? ()
#243 0x00002b44b5e65339 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#244 0x00000177d27806b9 in ?? ()
#245 0x00002b44b5e654a1 in ?? ()
#246 0x00002b44b5e65099 in ?? ()
#247 0x00002b44b5e656e9 in ?? ()
#248 0x00000177d27804e9 in ?? ()
#249 0x00002b44b5e64879 in ?? ()
#250 0x000028581670ba91 in ?? ()
#251 0x00003dd32937f879 in ?? ()
#252 0x00003e99f5386699 in ?? ()
#253 0x0000000000000003 in ?? ()
#254 0x00002b44b5e64c41 in ?? ()
#255 0x00002b44b5e64969 in ?? ()
#256 0x00007ffefeda8e08 in ?? ()
#257 0x00007f1d3f80d6f5 in ?? ()
#258 0x00000177d27804e9 in ?? ()
#259 0x000005a13da86be9 in ?? ()
#260 0x00002b44b5e64dc9 in ?? ()
#261 0x00002b44b5e64dc9 in ?? ()
#262 0x000005a13da86be9 in ?? ()
#263 0x00002b44b5e64c41 in ?? ()
#264 0x00003dd32934e441 in ?? ()
#265 0x00003e99f53864b1 in ?? ()
#266 0x0000000000000001 in ?? ()
#267 0x00002b44b5e64f09 in ?? ()
#268 0x00002b44b5e64d01 in ?? ()
#269 0x00007ffefeda8e60 in ?? ()
#270 0x00007f1d3f80b7fc in ?? ()
#271 0x00000177d27804e9 in ?? ()
#272 0x00000177d27804e9 in ?? ()
#273 0x00000177d27804e9 in ?? ()
#274 0x00002b44b5e64f09 in ?? ()
#275 0x00003dd329348761 in ?? ()
#276 0x000028d1ffe1e191 in ?? ()
#277 0x0000000000000001 in ?? ()
#278 0x00002b44b5e65009 in ?? ()
#279 0x00002b44b5e64f49 in ?? ()
#280 0x00007ffefeda8eb8 in ?? ()
#281 0x00007f1d3f78eacf in ?? ()
#282 0x00000177d27804e9 in ?? ()
#283 0x00000177d27804e9 in ?? ()
#284 0x000013e8c5dcf011 in ?? ()
#285 0x00000177d27804e9 in ?? ()
#286 0x0000215cd87092e1 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#287 0x000028d1ffe1dc21 in ?? ()
#288 0x0000000000000004 in ?? ()
#289 0x000035da9aa6c019 in ?? ()
#290 0x000013e8c5dcf011 in ?? ()
#291 0x00007ffefeda8f40 in ?? ()
#292 0x00007f1d3f80c7e0 in ?? ()
#293 0x000013e8c5dcfd51 in ?? ()
#294 0x00002b44b5e64f89 in ?? ()
#295 0x00002b44b5e64fc9 in ?? ()
#296 0x00002b44b5e65009 in ?? ()
#297 0x00002b44b5e65009 in ?? ()
#298 0x00002b44b5e64fc9 in ?? ()
#299 0x00002b44b5e64f89 in ?? ()
#300 0x000013e8c5dcfd51 in ?? ()
#301 0x000035da9aa6c019 in ?? ()
#302 0x000013e8c5dcf011 in ?? ()
#303 0x00001f6df86cf5c9 in ?? ()
#304 0x000028d1ffe1d9a9 in ?? ()
#305 0x0000000000000002 in ?? ()
#306 0x000035da9aa6bfd9 in ?? ()
#307 0x00002b44b5e64f49 in ?? ()
#308 0x00007ffefeda8fc8 in ?? ()
#309 0x00007f1d3f81119a in ?? ()
#310 0x000013e8c5dcfd51 in ?? ()
#311 0x00002b44b5e64f09 in ?? ()
#312 0x00000177d27804e9 in ?? ()
#313 0x00000177d27804e9 in ?? ()
#314 0x00000177d27804e9 in ?? ()
#315 0x00002b44b5e64f09 in ?? ()
#316 0x000013e8c5dcfd51 in ?? ()
#317 0x000035da9aa6bfd9 in ?? ()
#318 0x00000177d27804e9 in ?? ()
#319 0x0000007700000000 in ?? ()
#320 0x00001f6df86d0f89 in ?? ()
#321 0x00003e99f5386249 in ?? ()
#322 0x0000000000000001 in ?? ()
#323 0x00002b44b5e64e09 in ?? ()
#324 0x00002b44b5e64d01 in ?? ()
#325 0x00007ffefeda9030 in ?? ()
#326 0x00007f1d3f807a67 in ?? ()
#327 0x00000177d27804e9 in ?? ()
#328 0x00000177d27804e9 in ?? ()
#329 0x00000177d27804e9 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#330 0x000031215493a6d1 in ?? ()
#331 0x00001f242158cfb1 in ?? ()
#332 0x00002b44b5e64e09 in ?? ()
#333 0x000005e047707e89 in ?? ()
#334 0x000028d1ffe251d1 in ?? ()
#335 0x0000000000000001 in ?? ()
#336 0x00002b44b5e64ec9 in ?? ()
#337 0x00002b44b5e64d01 in ?? ()
#338 0x00007ffefeda9088 in ?? ()
#339 0x00007f1d3f78eacf in ?? ()
#340 0x00000177d27804e9 in ?? ()
#341 0x00000177d27804e9 in ?? ()
#342 0x000013e8c5dcf011 in ?? ()
#343 0x00000177d27804e9 in ?? ()
#344 0x0000215cd87092e1 in ?? ()
#345 0x000028d1ffe1dc21 in ?? ()
#346 0x0000000000000004 in ?? ()
#347 0x000035da9aa6c019 in ?? ()
#348 0x000013e8c5dcf011 in ?? ()
#349 0x00007ffefeda9148 in ?? ()
#350 0x00007f1d3f803aac in ?? ()
#351 0x000013e8c5dcfd51 in ?? ()
#352 0x00002b44b5e64e49 in ?? ()
#353 0x00002b44b5e64e89 in ?? ()
#354 0x00002b44b5e64ec9 in ?? ()
#355 0x00000177d27804e9 in ?? ()
#356 0x00000177d27804e9 in ?? ()
#357 0x00000177d27804e9 in ?? ()
#358 0x00002b44b5e64ec9 in ?? ()
#359 0x00002b44b5e64e89 in ?? ()
#360 0x00002b44b5e64e49 in ?? ()
#361 0x000013e8c5dcfd51 in ?? ()
#362 0x000035da9aa6c019 in ?? ()
#363 0x000013e8c5dcf011 in ?? ()
#364 0x00002b44b5e64c81 in ?? ()
#365 0x00000177d27804e9 in ?? ()
#366 0x0000007700000000 in ?? ()
#367 0x01632d1c00000000 in ?? ()
#368 0x000005e04770c5d9 in ?? ()
#369 0x000028d1ffe246a1 in ?? ()
#370 0x0000000000000002 in ?? ()
#371 0x000035da9aa6c1d9 in ?? ()
#372 0x00002b44b5e64d01 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#373 0x00007ffefeda91d8 in ?? ()
#374 0x00007f1d3f80b75e in ?? ()
#375 0x000013e8c5dcfd51 in ?? ()
#376 0x00002b44b5e64cc1 in ?? ()
#377 0x00002b44b5e64ab1 in ?? ()
#378 0x00002b44b5e64cc1 in ?? ()
#379 0x000013e8c5dcfd51 in ?? ()
#380 0x000035da9aa6c1d9 in ?? ()
#381 0x00002b44b5e648b9 in ?? ()
#382 0x00002b44b5e649c9 in ?? ()
#383 0x00002b44b5e64c81 in ?? ()
#384 0x00002b44b5e64c41 in ?? ()
#385 0x0000000300000000 in ?? ()
#386 0x00003dd329348631 in ?? ()
#387 0x00000e58df570639 in ?? ()
#388 0x0000000000000004 in ?? ()
#389 0x00002b44b5e64929 in ?? ()
#390 0x00002b44b5e64969 in ?? ()
#391 0x00007ffefeda92f8 in ?? ()
#392 0x00007f1d3f817b25 in ?? ()
#393 0x00000177d27804e9 in ?? ()
#394 0x00002b44b5e61329 in ?? ()
#395 0x000021b990e55621 in ?? ()
#396 0x000021b990e558b9 in ?? ()
#397 0x00000177d27804e9 in ?? ()
#398 0x00000177d27804e9 in ?? ()
#399 0x000021b990e7f211 in ?? ()
#400 0x00002b44b5e63439 in ?? ()
#401 0x000021b990e558b9 in ?? ()
#402 0x000021b990e55621 in ?? ()
#403 0x00002b44b5e61329 in ?? ()
#404 0x000005e04771fcc9 in ?? ()
#405 0x00000a1ff5be7ee9 in ?? ()
#406 0x00002b44b5e64929 in ?? ()
#407 0x00000177d27804e9 in ?? ()
#408 0x00000177d27804e9 in ?? ()
#409 0x00000177d27804e9 in ?? ()
#410 0x00002b44b5e61329 in ?? ()
#411 0x00000177d27804e9 in ?? ()
#412 0x00002b44b5e63871 in ?? ()
#413 0x00000177d27804e9 in ?? ()
#414 0x000021b990e44ba9 in ?? ()
#415 0x000021b990e558b9 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#416 0x00000177d27804e9 in ?? ()
#417 0x00002b44b5e63439 in ?? ()
#418 0x00002b44b5e62939 in ?? ()
#419 0x000021b990e55621 in ?? ()
#420 0x00002b44b5e61329 in ?? ()
#421 0x00002b44b5e64651 in ?? ()
#422 0x000025248c1c6dc1 in ?? ()
#423 0x00001f22d6479a59 in ?? ()
#424 0x0000000000000002 in ?? ()
#425 0x000037384915b439 in ?? ()
#426 0x00002b44b5e637d9 in ?? ()
#427 0x00007ffefeda93a0 in ?? ()
#428 0x00007f1d3f80bfff in ?? ()
#429 0x00000177d27804e9 in ?? ()
#430 0x00002b44b5e62f81 in ?? ()
#431 0x00000177d27806b9 in ?? ()
#432 0x00002b44b5e63619 in ?? ()
#433 0x00002b44b5e635b9 in ?? ()
#434 0x00002b44b5e637b9 in ?? ()
#435 0x00000177d27804e9 in ?? ()
#436 0x000037384915b439 in ?? ()
#437 0x000028581670ba91 in ?? ()
#438 0x0000373849159f91 in ?? ()
#439 0x00002b44b5e63481 in ?? ()
#440 0x00000177d27804e9 in ?? ()
#441 0x0000000100000000 in ?? ()
#442 0x00002b44b5e634a1 in ?? ()
#443 0x00003dd3293456b1 in ?? ()
#444 0x000013e8c5df7ae9 in ?? ()
#445 0x0000000000000002 in ?? ()
#446 0x0000373849158a51 in ?? ()
#447 0x0000373849159f91 in ?? ()
#448 0x00007ffefeda94f0 in ?? ()
#449 0x00007f1d3f84ac27 in ?? ()
#450 0x000005e04772fdd1 in ?? ()
#451 0x00002b44b5e62f81 in ?? ()
#452 0x00000177d27804e9 in ?? ()
#453 0x00002d286f319ea1 in ?? ()
#454 0x00002d286f31a041 in ?? ()
#455 0x000021b990e446c9 in ?? ()
#456 0x0000000100000000 in ?? ()
#457 0x00002b44b5e63439 in ?? ()
#458 0x00002b44b5e62f81 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--
#459 0x000005e04772fdd1 in ?? ()
#460 0x0000373849158a51 in ?? ()
#461 0x0000000000000000 in ?? ()

@Hyodori04
Copy link
Author

lldb trace

(lldb) bt
* thread #1, name = 'next-server (v', stop reason = signal SIGABRT
  * frame #0: 0x00007f1d670c5e2c libc.so.6`__pthread_kill_implementation(threadid=<unavailable>, signo=6, no_tid=<unavailable>) at pthread_kill.c:44:76
    frame #1: 0x00007f1d67076fb2 libc.so.6`__GI_raise(sig=6) at raise.c:26:13
    frame #2: 0x00007f1d67061472 libc.so.6`__GI_abort at abort.c:79:7
    frame #3: 0x00007f1d670ba430 libc.so.6`__libc_message(action=do_abort, fmt="") at libc_fatal.c:155:5
    frame #4: 0x00007f1d670cf7aa libc.so.6`malloc_printerr(str=<unavailable>) at malloc.c:5660:3
    frame #5: 0x00007f1d670d18a8 libc.so.6`_int_free(av=0x00007f1d6720dc60, p=0x0000000009c7dbb0, have_lock=0) at malloc.c:4602:9
    frame #6: 0x00007f1d670d3e8f libc.so.6`__GI___libc_free(mem=<unavailable>) at malloc.c:3385:7
    frame #7: 0x00007f1811cfa269 libtensorflow.so.2`dnnl::impl::cpu::x64::avx512_common_gemm_f32::sgemm_nocopy_driver(char const*, char const*, long, long, long, float const*, float const*, long, float const*, long, float const*, float*, long, float const*) + 1561
    frame #8: 0x00007f1811cfa9ca libtensorflow.so.2`dnnl::impl::cpu::x64::jit_avx512_common_gemm_f32(int, char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, long const*, float const*, float*, long const*, float const*) + 1754
    frame #9: 0x00007f1811e8dd15 libtensorflow.so.2`dnnl_status_t dnnl::impl::cpu::x64::gemm_driver<float, float, float>(char const*, char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, float const*, long const*, float const*, float const*, float*, long const*, float const*, bool, dnnl::impl::cpu::x64::pack_type, dnnl::impl::cpu::x64::gemm_pack_storage_t*, bool) + 4757
    frame #10: 0x00007f18119eae2c libtensorflow.so.2`dnnl::impl::cpu::extended_sgemm(char const*, char const*, long const*, long const*, long const*, float const*, float const*, long const*, float const*, long const*, float const*, float*, long const*, float const*, bool) + 300
    frame #11: 0x00007f181163c473 libtensorflow.so.2`dnnl_sgemm + 99
    frame #12: 0x00007f180e346161 libtensorflow.so.2`Eigen::internal::TensorContractionKernel<float, float, float, long, Eigen::internal::blas_data_mapper<float, long, 0, 0, 1>, Eigen::internal::TensorContractionInputMapper<float, long, 1, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 8, true, false, 0, Eigen::MakePointer>, Eigen::internal::TensorContractionInputMapper<float, long, 0, Eigen::TensorEvaluator<Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::ThreadPoolDevice>, Eigen::array<long, 1ul>, Eigen::array<long, 1ul>, 8, true, false, 0, Eigen::MakePointer> >::invoke(Eigen::internal::blas_data_mapper<float, long, 0, 0, 1> const&, Eigen::internal::ColMajorBlock<float, long> const&, Eigen::internal::ColMajorBlock<float, long> const&, long, long, long, float, float) + 145
    frame #13: 0x00007f180e350095 libtensorflow.so.2`Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::kernel(long, long, long, bool) + 549
    frame #14: 0x00007f180e351f4c libtensorflow.so.2`Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::pack_rhs(long, long) + 1036
    frame #15: 0x00007f180e352591 libtensorflow.so.2`Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::enqueue_packing_helper(long, long, long, bool) + 385
    frame #16: 0x00007f180e352558 libtensorflow.so.2`Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::EvalParallelContext<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, true, true, false, 0>::enqueue_packing_helper(long, long, long, bool) + 328
    frame #17: 0x00007f180e36afdb libtensorflow.so.2`void Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::evalProductImpl<Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback, 0>(float*, Eigen::TensorEvaluator<Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const, Eigen::ThreadPoolDevice>::NoCallback) const + 5643
    frame #18: 0x00007f180e36bf01 libtensorflow.so.2`Eigen::internal::TensorExecutor<Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<float, 2, 1, long>, 16, Eigen::MakePointer>, Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const> const, Eigen::ThreadPoolDevice, true, (Eigen::internal::TiledEvaluation)0>::run(Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<float, 2, 1, long>, 16, Eigen::MakePointer>, Eigen::TensorContractionOp<Eigen::array<Eigen::IndexPair<long>, 1ul> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::TensorMap<Eigen::Tensor<float const, 2, 1, long>, 16, Eigen::MakePointer> const, Eigen::NoOpOutputKernel const> const> const&, Eigen::ThreadPoolDevice const&) + 657
    frame #19: 0x00007f1810b54bc0 libtensorflow.so.2`tensorflow::(anonymous namespace)::LaunchGeneric<Eigen::ThreadPoolDevice, float>::operator()(tensorflow::OpKernelContext*, tensorflow::Tensor const&, tensorflow::Tensor const&, int, int, int, int, tensorflow::Padding const&, std::vector<long, std::allocator<long> > const&, tensorflow::Tensor*, tensorflow::TensorFormat) (.isra.0.constprop.0) + 1712
    frame #20: 0x00007f1810b54e01 libtensorflow.so.2`tensorflow::LaunchConv2DOp<Eigen::ThreadPoolDevice, float>::operator()(tensorflow::OpKernelContext*, bool, bool, tensorflow::Tensor const&, tensorflow::Tensor const&, int, int, int, int, tensorflow::Padding const&, std::vector<long, std::allocator<long> > const&, tensorflow::Tensor*, tensorflow::TensorFormat) + 561
    frame #21: 0x00007f1810b55d3f libtensorflow.so.2`tensorflow::Conv2DOp<Eigen::ThreadPoolDevice, float>::Compute(tensorflow::OpKernelContext*) + 431
    frame #22: 0x00007f1806d7ffbb libtensorflow_framework.so.2`tensorflow::ThreadPoolDevice::Compute(tensorflow::OpKernel*, tensorflow::OpKernelContext*) + 75
    frame #23: 0x00007f180cce9187 libtensorflow.so.2`tensorflow::KernelAndDeviceOp::Run(tensorflow::ScopedStepContainer*, tensorflow::EagerKernelArgs const&, std::vector<absl::lts_20211102::variant<tensorflow::Tensor, tensorflow::TensorShape>, std::allocator<absl::lts_20211102::variant<tensorflow::Tensor, tensorflow::TensorShape> > >*, tensorflow::CancellationManager*, absl::lts_20211102::optional<tensorflow::EagerFunctionParams> const&, absl::lts_20211102::optional<tensorflow::ManagedStackTrace> const&, tensorflow::CoordinationServiceAgent*) + 2503
    frame #24: 0x00007f180cc997c9 libtensorflow.so.2`tensorflow::EagerKernelExecute(tensorflow::EagerContext*, absl::lts_20211102::InlinedVector<tensorflow::TensorHandle*, 4ul, std::allocator<tensorflow::TensorHandle*> > const&, absl::lts_20211102::optional<tensorflow::EagerFunctionParams> const&, std::unique_ptr<tensorflow::KernelAndDevice, tensorflow::core::RefCountDeleter> const&, tensorflow::GraphCollector*, tensorflow::CancellationManager*, absl::lts_20211102::Span<tensorflow::TensorHandle*>, absl::lts_20211102::optional<tensorflow::ManagedStackTrace> const&) + 649
    frame #25: 0x00007f180cc9ab89 libtensorflow.so.2`tensorflow::ExecuteNode::Run() + 457
    frame #26: 0x00007f180cce0d50 libtensorflow.so.2`tensorflow::EagerExecutor::SyncExecute(tensorflow::EagerNode*) + 1040
    frame #27: 0x00007f180cc94c46 libtensorflow.so.2`tensorflow::(anonymous namespace)::EagerLocalExecute(tensorflow::EagerOperation*, tensorflow::TensorHandle**, int*) + 5686
    frame #28: 0x00007f180cc952b4 libtensorflow.so.2`tensorflow::EagerExecute(tensorflow::EagerOperation*, tensorflow::TensorHandle**, int*) + 596
    frame #29: 0x00007f180b076ae0 libtensorflow.so.2`tensorflow::EagerOperation::Execute(absl::lts_20211102::Span<tensorflow::AbstractTensorHandle*>, int*) + 512
    frame #30: 0x00007f180ccf544a libtensorflow.so.2`tensorflow::CustomDeviceOpHandler::Execute(tensorflow::ImmediateExecutionOperation*, tensorflow::ImmediateExecutionTensorHandle**, int*) + 1498
    frame #31: 0x00007f1808d4f9f6 libtensorflow.so.2`TFE_Execute + 102
    frame #32: 0x00007f1d6477ffcb tfjs_binding.node`tfnodejs::TFJSBackend::ExecuteOp(napi_env__*, napi_value__*, napi_value__*, napi_value__*, napi_value__*) + 1867
    frame #33: 0x00007f1d647835f0 tfjs_binding.node`tfnodejs::ExecuteOp(napi_env__*, napi_callback_info__*) + 672
    frame #34: 0x0000000000c51049 node`v8impl::(anonymous namespace)::FunctionCallbackWrapper::Invoke(v8::FunctionCallbackInfo<v8::Value> const&) + 137
    frame #35: 0x000000000281d600 node`vtable for v8impl::(anonymous namespace)::FunctionCallbackWrapper + 16
    frame #36: 0x0000000000f0c81c node`v8::internal::InvokeFunctionCallback(v8::FunctionCallbackInfo<v8::Value> const&, void (*)(v8::FunctionCallbackInfo<v8::Value> const&)) + 204
    frame #37: 0x00000000018d759d node`Builtins_CallApiCallback + 221
    frame #38: 0x00007f1d3f891ffc
    frame #39: 0x00007f1d3f8138d0
    frame #40: 0x00007f1d3f810e07
    frame #41: 0x00007f1d3f97161f
    frame #42: 0x00007f1d3f807a67
    frame #43: 0x00007f1d3f78eacf
    frame #44: 0x00007f1d3f803aac
    frame #45: 0x00007f1d3f804f41
    frame #46: 0x00007f1d3f815297
    frame #47: 0x00007f1d3f80d45f
    frame #48: 0x00007f1d3f80d6f5
    frame #49: 0x00007f1d3f80b7fc
    frame #50: 0x00007f1d3f78eacf
    frame #51: 0x00007f1d3f80c7e0
    frame #52: 0x00007f1d3f81119a
    frame #53: 0x00007f1d3f807a67
    frame #54: 0x00007f1d3f78eacf
    frame #55: 0x00007f1d3f803aac
    frame #56: 0x00007f1d3f80b75e
    frame #57: 0x00007f1d3f817b25
    frame #58: 0x00007f1d3f80bfff
    frame #59: 0x00007f1d3f84ac27
    frame #60: 0x00007f1d3f80d7b5
    frame #61: 0x00007f1d3f80b7fc
    frame #62: 0x00007f1d3f78eacf
    frame #63: 0x00007f1d3f80c7e0
    frame #64: 0x00007f1d3f80b99b
    frame #65: 0x00007f1d3f81def8
    frame #66: 0x00007f1d3f80b1d4
    frame #67: 0x00007f1d3f806f55
    frame #68: 0x00007f1d3f80b7fc
    frame #69: 0x00007f1d3f78eacf
    frame #70: 0x00007f1d3f80c7e0
    frame #71: 0x00007f1d3f80b99b
    frame #72: 0x00007f1d3f958238
    frame #73: 0x00007f1d3f958419
    frame #74: 0x00007f1d3f90ab6d
    frame #75: 0x00007f1d3f90afbb
    frame #76: 0x00007f1d3f80b7fc
    frame #77: 0x00007f1d3f78eacf
    frame #78: 0x00007f1d3f80c7e0
    frame #79: 0x00007f1d3f80b99b
    frame #80: 0x00007f1d3f970e3f
    frame #81: 0x000000000190dd43 node`Builtins_AsyncFunctionAwaitResolveClosure + 67
    frame #82: 0x00000000019c5bf1 node`Builtins_PromiseFulfillReactionJob + 49
    frame #83: 0x00000000018fda34 node`Builtins_RunMicrotasks + 628
    frame #84: 0x00000000018d4003 node`Builtins_JSRunMicrotasksEntry + 131
    frame #85: 0x00000000010505bd node`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 1421
    frame #86: 0x00000000010517ef node`v8::internal::Execution::TryRunMicrotasks(v8::internal::Isolate*, v8::internal::MicrotaskQueue*) + 143
    frame #87: 0x0000000001085166 node`v8::internal::MicrotaskQueue::RunMicrotasks(v8::internal::Isolate*) + 150
    frame #88: 0x00000000018d5d1c node`Builtins_InterpreterEntryTrampoline + 220
    frame #89: 0x00000000010854fd node`v8::internal::MicrotaskQueue::PerformCheckpoint(v8::Isolate*) + 61
    frame #90: 0x0000000000f57eaf node`v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) + 303
    frame #91: 0x0000000000f5871d node`v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<false>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, unsigned long*, int) + 141
    frame #92: 0x0000000000f58be5 node`v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) + 277
    frame #93: 0x0000000001963df6 node`Builtins_CEntry_Return1_ArgvOnStack_BuiltinExit + 54
    frame #94: 0x00007f1d3f6af766
    frame #95: 0x00000000018d40dc node`Builtins_JSEntryTrampoline + 92
    frame #96: 0x00000000018d3e03 node`Builtins_JSEntry + 131
    frame #97: 0x000000000105015b node`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 299
    frame #98: 0x00000000010511f4 node`v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) + 100
    frame #99: 0x0000000000f138cd node`v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) + 333
    frame #100: 0x0000000000bc8daf node`node::InternalCallbackScope::Close() + 655
    frame #101: 0x0000000000bc912b node`node::InternalMakeCallback(node::Environment*, v8::Local<v8::Object>, v8::Local<v8::Object>, v8::Local<v8::Function>, int, v8::Local<v8::Value>*, node::async_context) + 619
    frame #102: 0x0000000000be029f node`node::AsyncWrap::MakeCallback(v8::Local<v8::Function>, int, v8::Local<v8::Value>*) + 127
    frame #103: 0x0000000000dd7417 node`node::StreamBase::CallJSOnreadMethod(long, v8::Local<v8::ArrayBuffer>, unsigned long, node::StreamBase::StreamBaseJSChecks) + 167
    frame #104: 0x0000000000dd77e6 node`node::EmitToJSStreamListener::OnStreamRead(long, uv_buf_t const&) + 502
    frame #105: 0x0000000000e9e738 node`node::crypto::TLSWrap::ClearOut() + 280
    frame #106: 0x0000000000ea00d0 node`node::crypto::TLSWrap::OnStreamRead(long, uv_buf_t const&) + 160
    frame #107: 0x0000000000ddf14f node`node::LibuvStreamWrap::OnUvRead(long, uv_buf_t const*) + 143
    frame #108: 0x0000000000ddf56a node`node::LibuvStreamWrap::ReadStart()::'lambda0'(uv_stream_s*, long, uv_buf_t const*)::_FUN(uv_stream_s*, long, uv_buf_t const*) + 90
    frame #109: 0x00000000018bdba5 node`uv__read(stream=0x00007f1d00000000) at stream.c:1143:7
    frame #110: 0x00000000018bded0 node`uv__stream_io(loop=<unavailable>, w=0x00007f1d00000000, events=112775744) at stream.c:1203:5
    frame #111: 0x00007ffefede27fa linux-vdso.so.1
    frame #112: 0x00000000018c593b node`uv__io_poll(loop=<unavailable>, timeout=<unavailable>) at linux.c:1485:11
    frame #113: 0x00000000018b1be7 node`uv_run(loop=0x00000000055eab40, mode=UV_RUN_DEFAULT) at core.c:447:5
    frame #114: 0x0000000000bc9be6 node`node::SpinEventLoopInternal(node::Environment*) + 342
    frame #115: 0x0000000000d0ce94 node`node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) (.part.0) + 148
    frame #116: 0x0000000000d0d92d node`node::NodeMainInstance::Run() + 205
    frame #117: 0x0000000000c71c0f node`node::Start(int, char**) + 1423
    frame #118: 0x00007f1d6706224a libc.so.6`__libc_start_call_main(main=(node`main), argc=2, argv=0x00007ffefedb3238) at libc_start_call_main.h:58:16
    frame #119: 0x00007f1d67062305 libc.so.6`__libc_start_main_impl(main=(node`main), argc=2, argv=0x00007ffefedb3080, init=0x000000000000000e, fini=<unavailable>, rtld_fini=<unavailable>, stack_end=0x00007ffefedb3228) at libc-start.c:360:3
    frame #120: 0x0000000000bc630e node`_start + 46

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:node.js type:bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants