issues Search Results · repo:pytorch/TensorRT language:Python
Filter by
1k results
(85 ms)1k results
inpytorch/TensorRT (press backspace or delete to remove)Bug Description
When compiling Bert, a device mismatch occurs. This seems to be caused by weights moved to CPU during compilation.
To Reproduce
Steps to reproduce the behavior:
Run this script:
import ...
bug
cehongwang
- 3
- Opened 2 days ago
- #3450
Bug Description
To Reproduce
Steps to reproduce the behavior:
1. Prepare torch-tensorrt convert code
model = MyModel(opt)
model.load_staste_dict(torch.load( model.pth ))
inputs = torch_tensorrt.Input(min_shape=[int(min_batch_size), ...
bug
Fulitcher
- 7
- Opened 7 days ago
- #3448
❓ Question
When trying to compile the FLUX.1-dev model using Torch-TensorRT following the official example/blog post, I m
encountering a ValueError during the torch_tensorrt.dynamo.compile() step. The ...
question
yachty66
- 8
- Opened 9 days ago
- #3446
Is your feature request related to a problem? Please describe. TensorRT 10.8.0 added support for tiling optimization.
feature request
HolyWu
- 1
- Opened 12 days ago
- #3443
Is your feature request related to a problem? Please describe. PyTorch nightly builds have bumped to 2.8.0.dev
since 20250313.
feature request
- Opened 13 days ago
- #3441
To Reproduce
from __future__ import annotations
import os
import torch
import torch_tensorrt
os.environ[ CI_BUILD ] = 1
dtype = torch.bfloat16
device = torch.device( cuda , 0)
class MyModule(torch.nn.Module): ...
bug
- 1
- Opened 15 days ago
- #3439
Bug Description
run refit_engine_example.py get “AssertionError: Refit Result is not correct. Refit failed”
Image
To Reproduce
python refit_engine_example.py
Environment
- Torch-TensorRT Version ...
bug
953250587
- 4
- Opened 15 days ago
- #3437
Bug Description
We test the main branch on CI and weekly auto trigger the CI tests against different TRT versions. However, it seems to
fail to test different TRT versions.
For example, in this CI test, ...
bug
zewenli98
- Opened 16 days ago
- #3434
Is your feature request related to a problem? Please describe. !--A clear and concise description of what the problem
is. Ex. I m always frustrated when [...]--
Support FP4 functionality on Blackwell ...
feature request
narendasan
- Opened 16 days ago
- #3433
Bug Description
Attempting torch.compile (backend = torch_tensorrt) the google/paligemma2-3b-pt-224 model, there is an unsupported ops
like below:
Supported Nodes:
- torch.ops.aten.unsqueeze.default ...
bug
chohk88
- Opened 16 days ago
- #3432
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.