Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A Simple Engine Build Fail on TensorRT 8.6 #3930

Open
Aktcob opened this issue Jun 7, 2024 · 4 comments
Open

A Simple Engine Build Fail on TensorRT 8.6 #3930

Aktcob opened this issue Jun 7, 2024 · 4 comments

Comments

@Aktcob
Copy link

Aktcob commented Jun 7, 2024

Hi, I build a simple onnx model on Tensorrt8.6. And I get an error:
mha_fusion.cpp:344: DCHECK(fc1_ && fc2_ && softmax_) failed.
Could not find any implementation for node {ForeignNode[onnx::MatMul_46 + (Unnamed Layer* 1) [Shuffle].../_reduce_mlp/_mlp/_mlp.3/Add]}.
ERROR: 10: [optimizer.cpp::computeCosts::3869] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[onnx::MatMul_46 + (Unnamed Layer* 1) [Shuffle].../_reduce_mlp/_mlp/_mlp.3/Add]}.)

debug.zip

@geraldstanje
Copy link

what datatype is matmul_46?

@lix19937
Copy link

@Aktcob Try to use trt10.01.

@EmilioZhao
Copy link

What's the root cause of this issue? We've met the same issue and cannot upgrade TensorRT from 8.6 to 10.01 in production environment. Are there any other solutions?

@lix19937
Copy link

lix19937 commented Jun 19, 2024

Node {ForeignNode[onnx::MatMul_46 + (Unnamed Layer* 1) [Shuffle].../_reduce_mlp/_mlp/_mlp.3/Add]} include many nodes that handle by trt internal Myelin-compiler, can you upload the full build log of trtexec with --verbose. @Aktcob

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants