Skip to content

R0050/2026-03-31/Q001 — Query Definition
Research R0050 — Journalism and Other Truth-Seeking Disciplines
Run 2026-03-31
Query Q001

Query as Received

Does any journalistic fact-checking framework include a hierarchical evidence quality scale, calibrated uncertainty language, structured bias assessment domains, or formal source reliability tiering? Search across IFCN, PolitiFact, NewsGuard, SPJ, BBC Editorial Guidelines, Bellingcat, and any other published fact-checking or verification methodologies.

Query as Clarified

  • Subject: Published methodologies of journalistic fact-checking and verification organizations
  • Scope: Whether any of these methodologies include four specific structured elements: (1) hierarchical evidence quality scale, (2) calibrated uncertainty language, (3) structured bias assessment domains, (4) formal source reliability tiering
  • Evidence basis: Published methodology documents, codes of practice, rating criteria, handbooks, and editorial guidelines from named organizations and any others discovered during research
  • Organizations explicitly named: IFCN, PolitiFact, NewsGuard, SPJ, BBC Editorial Guidelines, Bellingcat
  • Additional organizations discovered: European Journalism Centre (Verification Handbook), AP, Reuters

Ambiguities Identified

  1. "Hierarchical evidence quality scale" could mean either a ranking of evidence types (like OCEBM levels) or a graduated rating of individual pieces of evidence. The query is interpreted to include both forms.
  2. "Calibrated uncertainty language" could mean either formal probability scales (like ICD 203) or any structured vocabulary for expressing degrees of certainty. The query is interpreted to mean formalized, defined scales rather than informal hedging.
  3. "Structured bias assessment domains" could mean either assessment of source bias or assessment of the fact-checker's own bias. The query is interpreted to include both.
  4. The query asks whether frameworks "include" these elements — this could mean explicitly specified or implicitly practiced. The query is interpreted to focus on explicitly documented elements in published methodologies.

Sub-Questions

  1. Do IFCN, PolitiFact, or NewsGuard define a formal hierarchy of evidence types or quality levels in their published methodologies?
  2. Do any fact-checking frameworks use calibrated, defined uncertainty language (e.g., probability scales, confidence levels)?
  3. Do any journalism standards include structured bias assessment with defined domains (analogous to Cochrane/RoB 2 bias domains)?
  4. Do any frameworks formally tier source reliability using defined categories or scoring systems?
  5. Do verification handbooks (EJC, Bellingcat) provide structured evaluation frameworks beyond principles?

Hypotheses

ID Hypothesis Description
H1 At least one framework includes formal structured elements One or more journalistic frameworks include hierarchical evidence scales, calibrated uncertainty language, structured bias domains, or formal source tiering
H2 No framework includes any of these formal structured elements Journalism lacks all four structured elements across all examined frameworks
H3 Journalism has analogous but informal/implicit versions Journalistic frameworks contain recognizable analogues to these elements but do not formalize them into structured scales, domains, or tiers