Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature Request - Addition of Benchmarking for TRT-LLM #17

Open
aswkumar99 opened this issue Feb 19, 2024 · 0 comments
Open

Feature Request - Addition of Benchmarking for TRT-LLM #17

aswkumar99 opened this issue Feb 19, 2024 · 0 comments

Comments

@aswkumar99
Copy link
Contributor

The current TRT-LLM Materials discusses the Hands-on aspects of getting from a Model to Deployment in a Triton server.

Given that TRT-LLM focuses on Performance, we could have a section that discusses the performance aspects of TRT-LLM and the various optimisations that are available to the end user.
@aswkumar99 aswkumar99 changed the title Addition of Benchmarking for TRT-LLM Feature Request - Addition of Benchmarking for TRT-LLM Feb 19, 2024
programmah added a commit to programmah/End-to-End-LLM that referenced this issue Feb 26, 2024
@programmah
adding feature request openhackathons-org#14 openhackathons-org#15 op…
b09090e 
…enhackathons-org#17
programmah added a commit to programmah/End-to-End-LLM that referenced this issue Feb 28, 2024
@programmah
adding feature request openhackathons-org#14 openhackathons-org#15 op…
8b31ace 
…enhackathons-org#17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@aswkumar99