Skip to content

Is ReDrafter supported by the TensorRT-LLM backend? #610

@vkc1vk

Description

@vkc1vk

System Info

N/A

Who can help?

@byshiue

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

Is ReDrafter supported by the TensorRT-LLM backend for Triton?

Expected behavior

n/a

actual behavior

n/a

additional notes

n/a

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions