Confidence
Preserve the scope, scale, source, and calibration of every score.
A confidence assertion belongs to a specific claim. It records:
- the score and its explicit numeric scale
- whether the score was reported, derived, or assessed
- what the score describes through
scopeand optionalgranularity - whether the score is calibrated
- the entity, activity, or agent that supplied it
- the aggregation method and sample count when known
- kind
- reported
- score
- 0.91
- scale
- 0–1
- calibrated
- usually false
Measures recognition in the cited region — not field correctness.
Words, symbols, or regions from the OCR provider
- kind
- reported
- score
- 0.84
- scale
- 0–1
- calibrated
- only if documented
Separate assertion with its own scope. Derived scores use kind: derived.
Field or schema probability from the extractor
- kind
- assessed
- score
- 4
- scale
- 1–5
- calibrated
- as defined
Applied later; does not replace OCR or extraction scores.
Reviewer or evaluator judgment after the value exists
Explain how a score was produced
A confidence assertion can carry structured provenance for the score itself:
kindsays whether it was reported, derived, or assessedmethodidentifies the algorithm or assessment methodsourcesnames the entities, activities, or agents behind itsampleCountrecords how many observations contributedattributespreserves method-specific parameters or intermediate statistics
For example, a transform that was proven to preserve the same calendar date can record:
{
"score": 1,
"scale": { "min": 0, "max": 1 },
"kind": "derived",
"scope": "transformation",
"method": "openparser.transform.date-time-format.v1",
"calibrated": false,
"sources": [{ "type": "activity", "id": "activity:transform" }]
}The OpenParser profile stores bounded method-specific proof on the transform derivation. See Transform verification.
Keep source semantics
Retain confidence at the granularity supplied by the source. OCR providers may report confidence for symbols, words, blocks, table cells, or pages. A source-region aggregate still describes OCR recognition in that region; it is not the probability that a downstream extracted value is correct.
Fallback does not change ownership. If page confidence is the nearest score available for a cited cell, keep the assertion on the page entity and reference it as an inherited page recognition score. Do not copy the number onto the cell, evidence claim, or extracted field, because placement would imply unsupported cell- or field-level precision.
Keep scores from different scopes, scales, and providers as separate assertions. Combining OCR recognition and extraction confidence into one number would erase what each score measures.
Reported and derived assertions
Use kind: "reported" when a provider or model returned the score directly.
Preserve the original value and scale in namespaced attributes when the source
did not use the normalized range.
Use kind: "derived" for an aggregate or calculation. Record the method,
sample count, and source entities or activity so consumers can inspect how the
score was produced.
Use kind: "assessed" for a human or automated evaluation applied after the
value was produced.
Calibration
calibrated: true means the score has a documented probabilistic
interpretation for its declared scope. Most provider OCR confidence is
uncalibrated and should remain false.
Consumers should compare confidence only when scope, granularity, scale, provider semantics, and calibration are compatible.