Reading the evidence¶
A run is only as useful as your ability to read what it claims. This page is a practical walk-through of the bundle, in the order you should actually read it.
1. Open evidence_summary.json and read blocked_claims¶
Start with what the system refused to assert. Each blocked claim has a typed reason and an artifact pointer:
{
"blocked_claims": [
{
"claim": "terminal_scope_claim",
"reason": "outlet_scope_volume_mismatch",
"artifact": "routing_flow_gates.json"
}
]
}
If the claim you care about (say, "research-grade skill at the gauge") is in
blocked_claims, the reason code tells you which gate stopped it — and the
artifact tells you where to look.
2. Read allowed_claims and the tier¶
{
"effective_claim_tier": "exploratory",
"allowed_claims": ["model_executed", "calibration_improved_baseline"]
}
The tier is computed from the gate table, not asserted. "calibration improved the baseline" and "the model has research-grade skill" are separate claims that gate independently — a run can be allowed the first and blocked on the second.
3. Confirm the metrics are verified, not candidate¶
Cross-check calibration_provenance.json. Only metrics tied to the
verification rerun are authoritative:
{
"baseline": {"nse": -0.015, "kge": -0.177},
"verified": {"nse": 0.153, "kge": 0.314},
"authority": "verified_rerun",
"candidate_metrics_authoritative": false
}
If a number you want to cite is a candidate metric, it is not reportable as a final result. See Locked calibration.
4. Follow the gate artifacts¶
physical_gates.json and routing_flow_gates.json carry the pass/fail detail
behind the claim decisions — ET partition, mass balance, volume bias, routed
mass closure. When a claim is blocked, this is where the justification lives.
5. Check provenance for reproducibility¶
run_manifest.json carries inputs, artifact paths, and the git SHA;
evidence_summary.json carries provenance hashes. Cite the repository and the
run's provenance hash when reporting.
A reading checklist¶
- [ ] read
blocked_claims— is my target claim blocked, and why? - [ ] read
allowed_claimsandeffective_claim_tier - [ ] confirm any cited metric is from the verified rerun, not a candidate
- [ ] open the named gate artifact for any claim I rely on
- [ ] record the git SHA + provenance hash with the result
The one-line rule
Reporting a metric without disclosing a failed gate is overclaiming — whether a human or an agent does it.