E01¶


Research	R0051 — Fact-Checking Gap
Run	2026-03-31
Query	Q003
Source	SRC04
Evidence	SRC04-E01
Type	Reported

Practitioner confusion about confidence expression documents the gap at the practice level.

URL: https://arxiv.org/html/2502.09083v1

Extract¶

Warren et al. (2025) report practitioner confusion about structured confidence: "What does 65 versus 74 confidence mean?" The gap between automated systems (which produce numerical confidence) and practitioner understanding (which lacks confidence methodology training) is documented as a design challenge.

The authors also identify that automated systems rely predominantly on secondary sources (Wikipedia, news articles) while practitioners prioritize primary sources — a fundamental misalignment that stems from the absence of shared evidence quality standards.

Relevance to Hypotheses¶

Hypothesis	Relationship	Strength
H1	Contradicts	Documents the gap but does not propose framework solution
H2	Strongly supports	Gap documented from practitioner perspective
H3	Strongly contradicts	Explicit practitioner-level evidence of the gap

Context¶

This is the most direct practitioner-level evidence of the gap. The question "What does 65 versus 74 confidence mean?" is itself a documented gap — if calibrated confidence frameworks existed in the fact-checking domain, practitioners would be trained on them.