Skip to content

NVIDIA NeMo-Aligner v0.3.0.trtllm

Latest
Compare
Choose a tag to compare
@gshennvm gshennvm released this 03 May 18:34
· 7 commits to main since this release
e61121b

New features and optimizations

  • TRT-LLM support in the RLHF pipeline. This adds significant speedup(6.96x) over our previous implementation.

Container

Please refer to the Dockerfile which contains all the dependencies needed to run TRT-LLM and RLHF.

Learn More

For more information see our Paper and Usage Guide.