Skip to content

R0050/2026-03-31/Q001/H1

Statement

At least one journalistic fact-checking framework includes one or more of the four formal structured elements: hierarchical evidence quality scale, calibrated uncertainty language, structured bias assessment domains, or formal source reliability tiering.

Status

Current: Partially supported

NewsGuard's 9-criterion weighted scoring system (0-100 scale) constitutes a formal source reliability tiering mechanism, and PolitiFact's Truth-O-Meter provides a structured graduated rating scale for claims. These are partial matches — they rate outlets and claims respectively, not evidence quality per se. No framework includes all four elements, and none includes elements directly analogous to ICD 203 calibrated probability language or Cochrane-style bias domains.

Supporting Evidence

Evidence Summary
SRC02-E01 NewsGuard's 9-criterion weighted scoring system with 0-100 scale and tiered ratings constitutes formal source reliability tiering
SRC01-E01 PolitiFact's six-level Truth-O-Meter provides graduated claim accuracy rating

Contradicting Evidence

Evidence Summary
SRC03-E01 IFCN Code of Principles contains no hierarchical scales, calibrated uncertainty language, or structured bias domains
SRC01-E02 PolitiFact has no formal evidence hierarchy, no structured bias assessment, and no source reliability tiering
SRC05-E01 Verification Handbook emphasizes principles over prescriptive rules; no formal scales or frameworks

Reasoning

H1 receives partial support because NewsGuard and PolitiFact do include structured rating systems. However, these are narrow matches: NewsGuard rates outlets (not individual evidence), and PolitiFact rates claim accuracy (not evidence quality). Neither constitutes a full hierarchical evidence quality scale comparable to OCEBM or GRADE. No framework includes calibrated uncertainty language or structured bias assessment domains. The partial match is genuine but limited.

Relationship to Other Hypotheses

H1 and H3 overlap significantly. The partial support for H1 is essentially the same finding as H3's core claim — that analogues exist but in informal or narrowly scoped forms. H2 is too absolute; the NewsGuard scoring system is clearly a formal, structured tool. The question is whether it counts as "source reliability tiering" in the sense intended by the query.

ACH Consistency

Rating Count
Consistent 2
Inconsistent 3
N/A 1