Skip to content

feat: add infino to clickbench - #1129

Open
naman-modi wants to merge 8 commits into
ClickHouse:mainfrom
infino-ai:submit-infino
Open

feat: add infino to clickbench#1129
naman-modi wants to merge 8 commits into
ClickHouse:mainfrom
infino-ai:submit-infino

Conversation

@naman-modi

@naman-modi naman-modi commented Jul 28, 2026

Copy link
Copy Markdown

Adds infino, a Rust engine that runs SQL, full-text (BM25), and vector search over one copy of your data on object storage. The data is spec-compliant Parquet on S3, Azure, GCS, or local disk, so anything that reads Parquet can read it. This entry runs the SQL path.

Some Pointers:

  • The harness is a single Rust binary that pulls only the published infino crate (0.1.10), with a committed lockfile and a plain release build, so a fresh VM reproduces it with nothing else to install. queries.sql is the same as the datafusion entry: the two type fixes datafusion does inline (day count to DATE, binary to UTF-8) are done at load time instead.
  • infino stays up as a server between queries. start opens the table once and serves it over a unix socket, query is a thin client, and BENCH_RESTARTABLE=yes restarts it before each cold run. That meets the true-cold rule (cold first run, warm second and third), so there is no lukewarm-cold-run tag.
  • Please Note: load includes infino compacting into its superfile format (256 MB segments). That is part of writing the data and is counted in load_time, not an optimize slipped in before the queries.

Ran the whole thing on a fresh c6a.4xlarge at 100M rows, built from crates.io: load, then the 43-query sweep with row counts checked. Hot sum 33.7s.

@CLAassistant

CLAassistant commented Jul 28, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@naman-modi
naman-modi temporarily deployed to benchmark-approval July 28, 2026 16:17 — with GitHub Actions Inactive
@naman-modi
naman-modi marked this pull request as ready for review July 28, 2026 16:24
@naman-modi

Copy link
Copy Markdown
Author

Disclaimer: I work at Infino AI.

@naman-modi

Copy link
Copy Markdown
Author

Hey @alexey-milovidov / @rschu1ze, opened this to add infino. Would appreciate a review whenever you get a chance, happy to change anything. Thanks!

@github-actions

Copy link
Copy Markdown
Contributor

The run of infino on c6a.4xlarge did not produce results.

Logs:

@alexey-milovidov alexey-milovidov added the machine:all PR benchmark on every machine type label Jul 28, 2026
@alexey-milovidov alexey-milovidov self-assigned this Jul 28, 2026
@alexey-milovidov alexey-milovidov removed the machine:all PR benchmark on every machine type label Jul 28, 2026
@alexey-milovidov

Copy link
Copy Markdown
Member

Build failed: https://pastila.nl/?0005853b/ad305de54c829af5dc2c24392b8dd3a4

@naman-modi

Copy link
Copy Markdown
Author

Fixed it @alexey-milovidov. install earlier assumed the runner VM had a C toolchain, but infino's build needs cc; it now apt-installs build-essential + pkg-config first. Would be great if you could re-trigger the run. Thanks!

@naman-modi
naman-modi deployed to benchmark-approval July 29, 2026 12:17 — with GitHub Actions Active
@github-actions

Copy link
Copy Markdown
Contributor

Results for infino are ready for: c6a.4xlarge.
This pull request is from a fork, so the automation cannot push to it; save this result as infino/results/20260729/c6a.4xlarge.json.
Tick "Allow edits by maintainers" on the pull request to let the automation commit the results itself.

Logs:

@naman-modi
naman-modi requested a deployment to benchmark-approval July 29, 2026 17:30 — with GitHub Actions Waiting
@naman-modi

Copy link
Copy Markdown
Author

I have updated the results for c6a.4xlarge from this run in the PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants