Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion .github/actions/setup-disk-benchmark/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,16 @@ runs:
steps:
- name: Install Rust
shell: bash
run: rustup show
run: |
Comment thread
arrayka marked this conversation as resolved.
if ! command -v rustup &>/dev/null; then
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y
echo "$HOME/.cargo/bin" >> "$GITHUB_PATH"
fi
Comment thread
arrayka marked this conversation as resolved.

- name: Show Rust toolchain
shell: bash
run: rustup show

- name: Install system dependencies
shell: bash
run: |
Expand Down
16 changes: 15 additions & 1 deletion .github/workflows/disk-benchmarks-aa.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ jobs:
# A/A benchmark: run main vs main to detect environment noise.
aa-benchmark:
name: A/A - ${{ matrix.dataset }}
runs-on: ubuntu-latest
runs-on: [ self-hosted, 1ES.Pool=diskann-github, ubuntu-latest ]
timeout-minutes: 120
strategy:
fail-fast: false
Expand All @@ -51,6 +51,20 @@ jobs:
archive: openai-100K.tar.gz

steps:
# Kept inline because this must run before checkout, but local action.yml
# files are only available after checkout.
- name: Mount high-speed NVMe SSD
shell: bash
run: |
sudo mkdir -p /mnt/nvme
sudo lsblk
sudo mkfs.ext4 /dev/nvme0n1
sudo mount /dev/nvme0n1 /mnt/nvme
sudo chmod 777 /mnt/nvme
mkdir -p /mnt/nvme/diskann_rust /mnt/nvme/baseline
ln -s /mnt/nvme/diskann_rust diskann_rust
ln -s /mnt/nvme/baseline baseline
Comment thread
arrayka marked this conversation as resolved.

- name: Checkout main
uses: actions/checkout@v4
with:
Expand Down
16 changes: 15 additions & 1 deletion .github/workflows/disk-benchmarks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ jobs:
# Macro benchmark: compare current branch against baseline
macro-benchmark:
name: Macro Benchmark - ${{ matrix.dataset }}
runs-on: ubuntu-latest
runs-on: [ self-hosted, 1ES.Pool=diskann-github, ubuntu-latest ]
Comment thread
arrayka marked this conversation as resolved.
# TODO: For production benchmarks, consider using a self-hosted runner with:
# - NVMe storage for consistent I/O performance
# - CPU pinning (taskset) for reduced variance
Expand All @@ -74,6 +74,20 @@ jobs:
data_dir: OpenAIArXiv

steps:
# Kept inline because this must run before checkout, but local action.yml
# files are only available after checkout.
- name: Mount high-speed NVMe SSD
shell: bash
run: |
sudo mkdir -p /mnt/nvme
sudo lsblk
sudo mkfs.ext4 /dev/nvme0n1
sudo mount /dev/nvme0n1 /mnt/nvme
sudo chmod 777 /mnt/nvme
mkdir -p /mnt/nvme/diskann_rust /mnt/nvme/baseline
Comment thread
arrayka marked this conversation as resolved.
ln -s /mnt/nvme/diskann_rust diskann_rust
ln -s /mnt/nvme/baseline baseline

- name: Checkout current branch
uses: actions/checkout@v4
with:
Expand Down
Loading