Skip to content

feat: Refactor LLM model zoo and add KV cache support #4004

feat: Refactor LLM model zoo and add KV cache support

feat: Refactor LLM model zoo and add KV cache support #4004

Triggered via pull request May 31, 2025 02:00
@peri044peri044
synchronize #3527
kv_cache
Status Success
Total duration 1h 23m 53s
Artifacts 3

build-test-windows.yml

on: pull_request
generate-matrix  /  generate
8s
generate-matrix / generate
filter-matrix
6s
filter-matrix
substitute-runner
3s
substitute-runner
Matrix: Build torch-tensorrt whl package
Matrix: Test core [Python]
Matrix: Test dynamo converters [Python]
Matrix: Test dynamo core [Python]
Matrix: Test dynamo cudagraphs [Python]
Matrix: Test dynamo frontend [Python]
Matrix: Test dynamo export serde [Python]
Matrix: Test torch compile backend [Python]
Matrix: Test torchscript frontend [Python]
Fit to window
Zoom out
Zoom in

Annotations

3 errors

Artifacts

Produced during runtime
Name Size Digest
pytorch_tensorrt__3.9_cu118_ Expired
1.69 MB
sha256:735d8ba35f2606f8cfcfefe9fbba31351f3e1b32244f871fd06cc0cd82859593
pytorch_tensorrt__3.9_cu126_ Expired
1.69 MB
sha256:566472fb857231a708f14225d93e59e2b1cbb494470ea83c9cb6823c7f922ce7
pytorch_tensorrt__3.9_cu128_ Expired
1.69 MB
sha256:eae30c2ebcaf79b1e54044a3a0ffbc03bd4f66d7511f247e8dc3b9bbba90c6a7