Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
e6e173a
Add Buildkite infrastructure for GPU job isolation
msaroufim Feb 4, 2026
ac46523
Add Buildkite infrastructure documentation
msaroufim Feb 4, 2026
8db4754
Update Buildkite docs with troubleshooting lessons learned
msaroufim Feb 4, 2026
2b97f30
Add simplified Buildkite setup script with proper GPU isolation
msaroufim Feb 4, 2026
41e141d
Fix git config permission error in setup script
msaroufim Feb 4, 2026
4c62ea3
Update Buildkite setup script with all fixes: environment hook, git H…
msaroufim Feb 5, 2026
1e06bb3
Add Docker-based pipeline with full resource isolation (GPU, CPU, RAM)
msaroufim Feb 5, 2026
6418772
Auto-detect CPU/RAM and divide by GPU count in environment hook
msaroufim Feb 5, 2026
6e77869
Add plugins-path to agent config for Docker plugin support
msaroufim Feb 5, 2026
5ff1574
Update buildkite.md with comprehensive progress summary
msaroufim Feb 5, 2026
02c1c10
Add inline steps support for artifact testing
msaroufim Feb 5, 2026
59de25d
Fix artifact download to follow S3 redirects
msaroufim Feb 5, 2026
c1596b5
Update buildkite.md with E2E workflow documentation
msaroufim Feb 5, 2026
78c61c2
Add Buildkite integration tests and real evaluation support
msaroufim Feb 5, 2026
8ebdcbb
Fix artifact upload by copying result to mounted volume
msaroufim Feb 5, 2026
690716c
Use buildkite-infrastructure branch for pipeline config
msaroufim Feb 5, 2026
cd1f25e
Update pipeline-eval.yml with working configuration
msaroufim Feb 5, 2026
29f1239
Update buildkite.md with working E2E evaluation docs
msaroufim Feb 5, 2026
0bcb540
Add Buildkite backend integration and pre-built image support
msaroufim Feb 5, 2026
c0dfd97
Add L40S_BK to GPU_TO_SM and clarify env var docs
msaroufim Feb 5, 2026
f459820
Add E2E test with database and document known limitations
msaroufim Feb 5, 2026
df9c202
Fix CI: skip gracefully when KERNELBOT_PAYLOAD not set
msaroufim Feb 5, 2026
14d27f3
Add Buildkite integration tests to CI workflow
msaroufim Feb 5, 2026
95b0a84
Fix lint: add noqa for C901 complexity in scripts
msaroufim Feb 5, 2026
38069fc
Fix default Buildkite org to mark-saroufim
msaroufim Feb 5, 2026
3c585f5
Add org/billing limitation to buildkite docs
msaroufim Feb 5, 2026
2397cca
Fix default Buildkite org to mark-saroufim in env and launcher
msaroufim Feb 5, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions .github/workflows/testing.yml
Original file line number Diff line number Diff line change
Expand Up @@ -63,3 +63,16 @@ jobs:
- uses: astral-sh/setup-uv@v4
- run: uv sync --extra dev
- run: uv run pytest -m integration tests/test_github.py -v

integration-tests-buildkite:
runs-on: ubuntu-latest
timeout-minutes: 30
# Skip for Dependabot PRs as they don't have access to secrets
if: github.actor != 'dependabot[bot]'
env:
BUILDKITE_API_TOKEN: ${{ secrets.BUILDKITE_API_TOKEN }}
steps:
- uses: actions/checkout@v4
- uses: astral-sh/setup-uv@v4
- run: uv sync --extra dev
- run: uv run pytest -m integration tests/test_buildkite.py -v
Loading
Loading