Summary
Benchmark the core mutation engine throughput across single mutation and batch execution paths.
Goal
Measure how the core runtime behaves under the execution shapes that matter most for throughput so regressions and improvements are visible over time.
Problem
The core benchmark umbrella needs at least one concrete throughput focused benchmark to establish useful baseline. Without measuring execution throughput directly, it is difficult to tell whether changes in the engine, batching logic, or state handling have meaningful performance impact.
This issue targets the core mutation engine itself and keeps the benchmark scenarios close to the actual runtime paths used by the library.
Scope
Design Expectations
- Benchmarks should reflect real execution paths rather than artificial loops.
- Batch and single mutation measurements should be reported separately.
- State size variations should be explicit so performance trends are easy to interpret.
- The benchmark setup should stay lightweight and not require unrelated test infrastructure.
- Any helper code should remain local to the benchmark project.
Suggested Measurements
- one mutation on small state
- one mutation on larger state
- batch execution over a fixed set of mutations
- batch execution over varying state sizes
Acceptance Criteria
Non-Goals
- This issue does not optimize the engine prematurely
- This issue does not add provider specific benchmarks
- This issue does not design full load testing suite
- This issue does not change runtime behavior
Notes
This issue is child of the benchmark umbrella #55.
Summary
Benchmark the core mutation engine throughput across single mutation and batch execution paths.
Goal
Measure how the core runtime behaves under the execution shapes that matter most for throughput so regressions and improvements are visible over time.
Problem
The core benchmark umbrella needs at least one concrete throughput focused benchmark to establish useful baseline. Without measuring execution throughput directly, it is difficult to tell whether changes in the engine, batching logic, or state handling have meaningful performance impact.
This issue targets the core mutation engine itself and keeps the benchmark scenarios close to the actual runtime paths used by the library.
Scope
Design Expectations
Suggested Measurements
Acceptance Criteria
Non-Goals
Notes
This issue is child of the benchmark umbrella
#55.