Open-source governance benchmark for workflow-orchestration platforms.
WorkflowBench scores workflow runtimes (n8n, Zapier, Make, Pipedream, Tray, Workato, Power Automate, Apache Airflow, Temporal) against six workflow-class threat models that GovernanceBench's agent-shape scenarios do not cover. Workflow runtimes execute DAGs of nodes with inbound triggers, intermediate state, and tool-call cascades -- a different shape from single-agent governance, with different attack surface.
WorkflowBench is sibling to GovernanceBench (agent-shape governance scoring) under the same Apache-2.0 license and the same publish-numeric-scores-only-for-live-adapter discipline.
WorkflowBench measures six workflow-class threats:
| # | Threat class | What it tests |
|---|---|---|
| WGB-T-A | Trigger-spoofing | Webhook / scheduler / email-trigger validation, signature checks, source attribution |
| WGB-T-B | Cascade-poisoning | LLM-call output flowing into downstream tool-call input without provenance attestation |
| WGB-T-C | Audit-bypass via node-reorder | Workflow author rearranges nodes to evade audit-checkpoint; chain integrity must catch reorder |
| WGB-T-D | Cross-workflow leak | One workflow's audit chain contaminates another's; workflow-scoped isolation must hold |
| WGB-T-E | Third-party-node supply-chain | Community-published node manifest contains adversarial behavior; pre-execute manifest verification must block |
| WGB-T-F | Workflow-replay tampering | Execution-history replay must produce identical audit chain or detect tamper |
50 scenarios total: WGB-001..050 distributed across the six classes.
npm install -g workflowbench
workflowbench run --adapter n8n --target http://localhost:5678
workflowbench report --format markdownWorkflowBench publishes adapters for runtime targets that expose a scoreable API surface:
n8n.mjs-- self-host n8n via Docker compose; tested against API v1agentomy.mjs-- reference adapter for Agentomy's governed workflow pathgeneric.mjs-- minimal stub for evaluator-built adapters
Submit additional adapters via the CONTRIBUTING guide. Workflow-orchestration platforms without a runnable governance API qualify for documentation-review tier per the same evidence-class policy as GovernanceBench.
Identical to GovernanceBench:
- Live-adapter measurements produce numeric leaderboard scores. Reproducible from the published adapter against the vendor's runnable target.
- Documentation-review entries are qualitative judgments against vendor-published specs. They do not produce numeric scores; they queue for live-adapter elevation when reproducible access becomes available.
Every WorkflowBench scenario maps to its GovernanceBench agent-shape equivalent where one exists, plus documents the coverage delta where workflow-shape diverges. See docs/WORKFLOW-GOVERNANCE-CATEGORY.md in the parent repo.
Apache-2.0. The benchmark, scenarios, and adapters are all open source. Run it against any platform and compare independently.