Introduces end-to-end benchmark concurrency configuration

[AnasSarkiz]

No description provided.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
tiny-hypergraph	Ready	Preview, Comment	May 29, 2026 1:22pm

[tscircuitbot]

Benchmark This PR

Run benchmarks by commenting on this PR:

/benchmark [benchmark.sh args...]
/benchmark --dataset <hg07|srj18> --limit <n> --solver <core|poly> --families <default|default+deep|all>

Everything after /benchmark is forwarded directly to ./benchmark.sh.
The result comment shows the matching dataset from the latest stored main-branch benchmark artifact beside the PR run; main is not rerun for each PR benchmark request.

Examples:

• /benchmark -> hg07, all samples, core solver
• /benchmark --dataset srj18 --limit 20 -> first 20 srj18 samples
• /benchmark --sample sample002 -> one hg07 sample
• /benchmark --limit 20 --solver poly -> first 20 hg07 samples with the poly solver
• /benchmark --limit 40 --families default+deep -> first 40 hg07 samples with deeper candidate families

Any PR whose title contains [BENCHMARK TEST] will automatically run the benchmark workflow on PR updates.

[AnasSarkiz]

/benchmark --dataset 18

[tscircuitbot]

Tiny Hypergraph Benchmark Results

Run	Dataset	Solver	Families	Samples	Success	Improved	P50	P95
Main	srj18	core	default	16	31.3%	60.0%	2.257s	7.668s
PR	srj18	core	default	16	31.3%	60.0%	2.209s	6.955s

Main Branch Details

Metric	Value
Dataset	srj18
Solver	core
Families	default
Samples	16
Success rate	31.3%
Improved rate	60.0%
Zero final max region cost rate	0.0%
Avg baseline max region cost	0.565
Avg final max region cost	0.499
Avg max region delta	0.066
Avg candidate count	5.200
Avg duration	2.602s
P50 duration	2.257s
P95 duration	7.668s

Sample	Status	Baseline	Final	Delta	Attempts	Duration	Error
sample001	success	0.670	0.579	0.090	4	2.275s
sample002	success	0.391	0.358	0.033	6	1.342s
sample003	success	0.429	0.429	0.000	5	0.655s
sample004	failed	n/a	n/a	n/a	0	0.025s	Error: Static reachability precheck failed: 2 route(s) have no legal path under the current reservation and start-reg...
sample005	success	0.423	0.423	0.000	7	1.030s
sample006	failed	n/a	n/a	n/a	0	0.258s	Error: Static reachability precheck failed: 9 route(s) have no legal path under the current reservation and start-reg...
sample007	failed	n/a	n/a	n/a	0	7.668s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample008	failed	n/a	n/a	n/a	0	2.373s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample009	failed	n/a	n/a	n/a	0	0.305s	Error: Static reachability precheck failed: 2 route(s) have no legal path under the current reservation and start-reg...
sample010	failed	n/a	n/a	n/a	0	3.706s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample011	failed	n/a	n/a	n/a	0	4.884s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample012	failed	n/a	n/a	n/a	0	6.774s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample013	failed	n/a	n/a	n/a	0	0.336s	Error: Static reachability precheck failed: 11 route(s) have no legal path under the current reservation and start-re...
sample014	failed	n/a	n/a	n/a	0	3.145s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample015	failed	n/a	n/a	n/a	0	4.602s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample016	success	0.912	0.707	0.205	4	2.257s

PR Details

Metric	Value
Dataset	srj18
Solver	core
Families	default
Samples	16
Success rate	31.3%
Improved rate	60.0%
Zero final max region cost rate	0.0%
Avg baseline max region cost	0.565
Avg final max region cost	0.499
Avg max region delta	0.066
Avg candidate count	5.200
Avg duration	2.504s
P50 duration	2.209s
P95 duration	6.955s

Sample	Status	Baseline	Final	Delta	Attempts	Duration	Error
sample001	success	0.670	0.579	0.090	4	2.410s
sample002	success	0.391	0.358	0.033	6	1.358s
sample003	success	0.429	0.429	0.000	5	0.611s
sample004	failed	n/a	n/a	n/a	0	0.025s	Error: Static reachability precheck failed: 2 route(s) have no legal path under the current reservation and start-reg...
sample005	success	0.423	0.423	0.000	7	1.251s
sample006	failed	n/a	n/a	n/a	0	0.253s	Error: Static reachability precheck failed: 9 route(s) have no legal path under the current reservation and start-reg...
sample007	failed	n/a	n/a	n/a	0	6.955s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample008	failed	n/a	n/a	n/a	0	2.243s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample009	failed	n/a	n/a	n/a	0	0.288s	Error: Static reachability precheck failed: 2 route(s) have no legal path under the current reservation and start-reg...
sample010	failed	n/a	n/a	n/a	0	3.543s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample011	failed	n/a	n/a	n/a	0	4.739s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample012	failed	n/a	n/a	n/a	0	6.832s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample013	failed	n/a	n/a	n/a	0	0.327s	Error: Static reachability precheck failed: 11 route(s) have no legal path under the current reservation and start-re...
sample014	failed	n/a	n/a	n/a	0	3.169s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample015	failed	n/a	n/a	n/a	0	3.855s	Error: TinyHyperGraphSectionPipelineSolver ran out of iterations
sample016	success	0.912	0.707	0.205	4	2.209s

Workflow: View run
Artifact: https://github.com/tscircuit/tiny-hypergraph/actions/runs/26637091170

[tscircuitbot]

---

Thank you for your contribution! 🎉

PR Rating: ⭐
Impact: Tiny

Track your contributions and see the leaderboard at: tscircuit Contribution Tracker

---