Skip to content

Evidence schema

The evidence bundle is a set of JSON / JSONL artifacts written to the run directory. This page lists the artifacts and the fields you will most often read. Treat the in-tree files as the source of truth — the schema is evolving toward a versioned, pydantic-owned schema_version: "1.0".

Schema versioning is in progress

A formal versioned schema (with a schema_version field, a typed claim model, and typed diagnostics) is planned. Until it lands, consume the bundle defensively: read the fields documented here, and tolerate additional keys.

Bundle artifacts

Artifact Format Contents
evidence_summary.json JSON gate results, claim tier vector, allowed/blocked claims
run_manifest.json JSON inputs, artifact paths, run summary, git SHA
events.jsonl JSONL append-only stage-by-stage execution trace
benchmark/benchmark_lock.json JSON sealed baseline metrics + alignment + hashes
calibration_provenance.json JSON candidate → lock → verification authority chain
physical_gates.json JSON ET / mass-balance / volume-bias gate decisions
routing_flow_gates.json JSON routed-flow mass-closure gate decisions

evidence_summary.json — key fields

Field Meaning
effective_claim_tier the granted tier (exploratorypublication_grade)
allowed_claims claims the gates support
blocked_claims claims refused, each with a reason and artifact
gate entries per-gate status with a pointer to the gate artifact

A blocked-claim entry has the shape:

{
  "claim": "terminal_scope_claim",
  "reason": "outlet_scope_volume_mismatch",
  "artifact": "routing_flow_gates.json"
}

calibration_provenance.json — authority

Field Meaning
baseline locked baseline metrics
verified metrics from the independent rerun — authoritative
authority which stage holds authority (verified_rerun)
candidate_metrics_authoritative always false — candidate metrics are not reportable

Claim tiers

Tier Granted when
exploratory the run executed; no quality claim supported
diagnostic outputs usable for diagnosis; specific gated sub-claims may hold
research_grade provenance + physical + verified-skill + outlet-scope gates pass
publication_grade research-grade + full-coverage sensitivity + strictest preconditions

See The evidence bundle and Reading the evidence.