Skip to content
github-actions[bot] edited this page Nov 15, 2026 · 1 revision

TileOPs Wiki

Perf Tracker

Every nightly benchmark compares each TileOPs op with its fastest comparator, workload by workload. The nightly workflow publishes the result in two places after it pushes the benchmark snapshot to TileOPs-nightly:

  • Perf Tracker pages, one per date. Each page lists the ops slower than their fastest comparator on at least one workload row, ordered by label and worst ratio, with the rows behind and the number of consecutive nightlies each op has been behind.
  • The Nightly Perf Tracker project, one item per op, where the team tracks who is closing each gap.

Do not edit the pages by hand: the next nightly overwrites them.

Labels

An op is labelled by its worst row.

Label Worst ratio (fastest comparator / TileOPs)
P0 below 0.50
P1 0.50 to 0.80
P2 0.80 to 0.90
P3 0.90 to 0.95
P4 0.95 to 0.99

The project

Each nightly updates the project automatically:

  • It writes Priority, Worst ratio, Rows behind, Nightlies behind, Category and Measured for every op in the queue.
  • It adds an item for an op that falls behind, and sets an op that falls behind again back to Unclaimed.
  • It moves an op that has caught up from Unclaimed, In progress, PR open or Awaiting nightly to Done, and archives it after 14 days in Done.

Everything else is edited by hand: assignees, item bodies, and the statuses In progress, PR open, Awaiting nightly, Needs decision and Accepted gap. Assign yourself and set In progress when you take an op.

Clone this wiki locally