New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updating TRT-LLM template #866
Conversation
truss/constants.py
Outdated
@@ -98,7 +98,7 @@ | |||
|
|||
REGISTRY_BUILD_SECRET_PREFIX = "DOCKER_REGISTRY_" | |||
|
|||
TRTLLM_BASE_IMAGE = "baseten/trtllm-build-server:r23.12_baseten_v0.7.1_20240111" | |||
TRTLLM_BASE_IMAGE = "baseten/trtllm-build-server:r23.12_baseten_v0.9.0_20240305" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we condition this to use the build server or the lighter weight server image based on if the build occurs on baseten?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
leaving this to a followup as some investigation is needed as to why the generic builder doesn't actually work due to package issues
馃殌 What
馃捇 How
馃敩 Testing