Skip to content

csubst benchmark plot

Jump to bottom
Kenji Fukushima edited this page Jun 3, 2026 · 1 revision

csubst benchmark-plot

csubst benchmark-plot collects existing csubst benchmark summaries, compares parameter-wise performance, and writes an overview figure. It does not rerun csubst search.

Minimal command

csubst benchmark-plot \
  --benchmark_dir . \
  --benchmark_plot_format pdf

By default, --benchmark_dir is scanned recursively for benchmark summaries. This makes it possible to compare multiple csubst_benchmark/ directories created under different project folders.

Common options

  • --benchmark_dir: root directory to scan for benchmark outputs
  • --benchmark_plot_recursive yes|no: whether to scan recursively
  • --benchmark_plot_metrics: numeric summary columns to compare
  • --benchmark_plot_format pdf|png|svg: overview-figure format

Output files

By default, outputs are written under csubst_benchmark_plot/, including:

  • csubst_benchmark_plot_runs.tsv
  • csubst_benchmark_plot_summary.tsv
  • csubst_benchmark_plot_summary.json
  • csubst_benchmark_plot_overview.pdf
  • csubst_outputs.tsv

Use --benchmark_plot_format png or --benchmark_plot_format svg if you want a different overview-figure format.

Related pages

Clone this wiki locally