-
-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'upstream' into openai-logprobs
- Loading branch information
Showing
175 changed files
with
5,215 additions
and
1,966 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,26 @@ | ||
#!/usr/bin/env bash | ||
|
||
set -euo pipefail | ||
|
||
# Install system packages | ||
apt update | ||
apt install -y curl jq | ||
|
||
# Install minijinja for templating | ||
curl -sSfL https://github.com/mitsuhiko/minijinja/releases/latest/download/minijinja-cli-installer.sh | sh | ||
source $HOME/.cargo/env | ||
|
||
# If BUILDKITE_PULL_REQUEST != "false", then we check the PR labels using curl and jq | ||
if [ "$BUILDKITE_PULL_REQUEST" != "false" ]; then | ||
PR_LABELS=$(curl -s "https://api.github.com/repos/vllm-project/vllm/pulls/$BUILDKITE_PULL_REQUEST" | jq -r '.labels[].name') | ||
|
||
if [[ $PR_LABELS == *"perf-benchmarks"* ]]; then | ||
echo "This PR has the 'perf-benchmarks' label. Proceeding with the nightly benchmarks." | ||
else | ||
echo "This PR does not have the 'perf-benchmarks' label. Skipping the nightly benchmarks." | ||
exit 0 | ||
fi | ||
fi | ||
|
||
# Upload sample.yaml | ||
buildkite-agent pipeline upload .buildkite/nightly-benchmarks/sample.yaml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,39 @@ | ||
steps: | ||
# NOTE(simon): You can create separate blocks for different jobs | ||
- label: "A100: NVIDIA SMI" | ||
agents: | ||
queue: A100 | ||
plugins: | ||
- kubernetes: | ||
podSpec: | ||
containers: | ||
# - image: us-central1-docker.pkg.dev/vllm-405802/vllm-ci-test-repo/vllm-test:$BUILDKITE_COMMIT | ||
# TODO(simon): check latest main branch or use the PR image. | ||
- image: us-central1-docker.pkg.dev/vllm-405802/vllm-ci-test-repo/vllm-test:45c35f0d58f4508bf43bd6af1d3d0d0ec0c915e6 | ||
command: | ||
- bash -c 'nvidia-smi && nvidia-smi topo -m && pwd && ls' | ||
resources: | ||
limits: | ||
nvidia.com/gpu: 8 | ||
volumeMounts: | ||
- name: devshm | ||
mountPath: /dev/shm | ||
nodeSelector: | ||
nvidia.com/gpu.product: NVIDIA-A100-SXM4-80GB | ||
volumes: | ||
- name: devshm | ||
emptyDir: | ||
medium: Memory | ||
# TODO(simon): bring H100 online | ||
# - label: "H100: NVIDIA SMI" | ||
# agents: | ||
# queue: H100 | ||
# plugins: | ||
# - docker#v5.11.0: | ||
# image: us-central1-docker.pkg.dev/vllm-405802/vllm-ci-test-repo/vllm-test:45c35f0d58f4508bf43bd6af1d3d0d0ec0c915e6 | ||
# command: | ||
# - bash -c 'nvidia-smi && nvidia-smi topo -m' | ||
# propagate-environment: true | ||
# ipc: host | ||
# gpus: all | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.