1 · Boundary
Selects an enabled simulation Target and policy Skill Runtime, discovers tasks, appends Sessions, aggregates evidence, and writes a report.
Executes one policy closed loop through SessionRunner, Target, Policy Client, Adapter, and Bridge. It does not orchestrate experiments.
Benchmarking does not create a new SKILLRUNTIME entry and does not instantiate SessionRunner directly.
2 · Availability Gate
SkillsLoader checks the Runtime workspace and target-enable overrides. This controls skill visibility; Runtime Preflight still validates every Session.
3 · Lifecycle
4 · Evidence
Final status, success, steps, return, latency, artifact path, and error code.
Session-indexed execution history.
Benchmark metadata, task/instance, chunks, reward, steps, and result metadata.
5 · Report Contract
Reports identify setup, suite/task source, metrics, missing-value policy, aggregate and per-task results, failure taxonomy, artifact paths, reproduction settings, and comparison scope. Reports reference evidence without rewriting it.