Skip to content

ci: add TPC-H SF10 workflow #1688

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
andygrove wants to merge 3 commits into
base: main
Choose a base branch
from
Open

ci: add TPC-H SF10 workflow #1688

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
76a8bfa
ci: add TPC-H SF10 workflow
andygrove May 11, 2026
bfee3f4
ci: restrict GITHUB_TOKEN to contents:read in tpch workflow
andygrove May 12, 2026
3725f18
ci: address review feedback on TPC-H SF10 workflow
andygrove May 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
159 changes: 159 additions & 0 deletions .github/workflows/tpch.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,159 @@
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.

name: TPC-H SF10

permissions:
contents: read

concurrency:
group: ${{ github.repository }}-${{ github.head_ref || github.sha }}-${{ github.workflow }}
cancel-in-progress: true

on:
push:
paths-ignore:
- "docs/**"
- "**.md"
- ".github/ISSUE_TEMPLATE/**"
- ".github/pull_request_template.md"
pull_request:
paths-ignore:
- "docs/**"
- "**.md"
- ".github/ISSUE_TEMPLATE/**"
- ".github/pull_request_template.md"
workflow_dispatch:

jobs:
tpch-sf10:
name: TPC-H SF10 (all queries)
runs-on: ubuntu-latest
container:
image: amd64/rust
steps:
- uses: actions/checkout@v6.0.2
with:
submodules: true
fetch-depth: 1

- name: Setup Rust toolchain
uses: ./.github/actions/setup-builder
with:
rust-version: stable

- name: Build Ballista binaries
run: |
cargo build --profile release-nonlto --locked \
-p ballista-scheduler \
-p ballista-executor \
-p ballista-benchmarks

- name: Install tpchgen-cli
uses: taiki-e/install-action@de6bbd1333b8f331563d54a051e542c7dfef81c3 # v2.68.34
with:
tool: tpchgen-cli@2.0.2

- name: Generate TPC-H SF10 data
run: |
mkdir -p "$RUNNER_TEMP/tpch-data"
tpchgen-cli \
--scale-factor 10 \
--parts 16 \
--format=parquet \
--output-dir "$RUNNER_TEMP/tpch-data"

- name: Run TPC-H queries against Ballista cluster
env:
DATA_DIR: ${{ runner.temp }}/tpch-data
WORK_DIR: ${{ runner.temp }}/work
SCHEDULER_LOG: ${{ runner.temp }}/scheduler.log
EXECUTOR_LOG: ${{ runner.temp }}/executor.log
run: |
set -euo pipefail

mkdir -p "$WORK_DIR"

./target/release-nonlto/ballista-scheduler \
--bind-host 127.0.0.1 \
> "$SCHEDULER_LOG" 2>&1 &
SCHEDULER_PID=$!

./target/release-nonlto/ballista-executor \
--bind-host 127.0.0.1 \
Comment thread
martin-g marked this conversation as resolved.
--bind-port 50051 \
--scheduler-host 127.0.0.1 \
--scheduler-connect-timeout-seconds 10 \
--concurrent-tasks 4 \
--memory-pool-size 2GB \
--work-dir "$WORK_DIR" \
Comment thread
martin-g marked this conversation as resolved.
> "$EXECUTOR_LOG" 2>&1 &
EXECUTOR_PID=$!

cleanup() {
echo "::group::scheduler log (tail)"
tail -n 200 "$SCHEDULER_LOG" || true
echo "::endgroup::"
echo "::group::executor log (tail)"
tail -n 200 "$EXECUTOR_LOG" || true
echo "::endgroup::"
kill "$SCHEDULER_PID" "$EXECUTOR_PID" 2>/dev/null || true
wait "$SCHEDULER_PID" "$EXECUTOR_PID" 2>/dev/null || true
}
trap cleanup EXIT

# Probe TCP readiness with bash's /dev/tcp so we don't need netcat
# in the container image.
wait_for_port() {
local host="$1" port="$2" name="$3"
echo "Waiting for $name on $host:$port..."
for _ in $(seq 1 30); do
if (exec 3<>/dev/tcp/"$host"/"$port") 2>/dev/null; then
exec 3<&- 3>&-
return 0
fi
sleep 1
done
echo "$name did not start"
return 1
}
wait_for_port 127.0.0.1 50050 scheduler
wait_for_port 127.0.0.1 50051 executor

# q16 omitted: still unsupported (matches benchmarks/run.sh).
for q in 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 17 18 19 20 21 22; do
echo "::group::Query $q"
./target/release-nonlto/tpch benchmark ballista \
--host 127.0.0.1 --port 50050 \
--query "$q" \
--path "$DATA_DIR" \
--format parquet \
--partitions 16 \
--iterations 1 \
-c datafusion.optimizer.prefer_hash_join=false
echo "::endgroup::"
done

- name: Upload cluster logs on failure
if: failure()
uses: actions/upload-artifact@v4
with:
name: tpch-sf10-cluster-logs
path: |
${{ runner.temp }}/scheduler.log
${{ runner.temp }}/executor.log
if-no-files-found: ignore
Comment thread
github-advanced-security[bot] marked this conversation as resolved.
Fixed
Loading