Q001 — Assessment¶


Research	R0050 — Journalism and Other Truth-Seeking Disciplines
Run	2026-03-31
Query	Q001

BLUF¶

No journalistic fact-checking framework includes all four structured elements (hierarchical evidence quality scale, calibrated uncertainty language, structured bias assessment domains, formal source reliability tiering). NewsGuard includes formal source reliability tiering via its 9-criterion weighted scoring system, and PolitiFact includes a graduated claim accuracy scale, but these are narrowly scoped. No framework includes calibrated uncertainty language or structured bias assessment domains. Journalism overwhelmingly relies on principle-based editorial judgment rather than formalized evaluation frameworks.

Answer¶

Rating: H3 (Informal analogues) · Confidence: High

Confidence rationale: Six independent sources spanning the major fact-checking and journalism organizations converge on the same finding. The evidence is clear and consistent. The only partial exception (NewsGuard) is well-documented and its scope limitation is evident from its own methodology documentation.

Reasoning Chain¶

IFCN, the world's most widely adopted fact-checking standard, defines five commitments focused on non-partisanship, source transparency, and methodology transparency — none of which include structured evaluation scales or frameworks. [SRC03-E01, High reliability, High relevance]
PolitiFact's Truth-O-Meter provides a six-level graduated scale for claim accuracy (TRUE through PANTS ON FIRE) but has no formal evidence hierarchy, no structured bias assessment, and no source reliability tiering. [SRC01-E01, High reliability, High relevance] [SRC01-E02, High reliability, High relevance]
NewsGuard operates a 9-criterion weighted 0-100 scoring system that produces tiered reliability ratings for news websites. This constitutes formal source reliability tiering, but it rates outlets rather than individual evidence. [SRC02-E01, High reliability, High relevance]
BBC Editorial Guidelines use informal source categories (agency, UGC, internet, biased sources) with advisory guidance but no formal scoring or tiering. [SRC04-E01, High reliability, Medium-High relevance]
The EJC Verification Handbook explicitly emphasizes principles and competencies over prescriptive frameworks, confirming the absence of structured evaluation tools. [SRC05-E01, High reliability, High relevance]
Bellingcat emphasizes methodology as practitioner skill with case-by-case assessment rather than formalized evaluation frameworks. [SRC06-E01, Medium-High reliability, Medium relevance]
JUDGMENT: The pattern across all six sources is consistent: journalism values verification, accuracy, and source quality but operationalizes these through editorial judgment and practitioner skill rather than formalized scales. Where formal structures exist (NewsGuard, PolitiFact), they rate outlets or claims, not evidence quality. No framework includes calibrated uncertainty language or structured bias assessment domains. [JUDGMENT]

Evidence Base Summary¶

Source	Description	Reliability	Relevance	Key Finding
SRC01	PolitiFact	High	High	Six-level claim scale; no evidence hierarchy or bias assessment
SRC02	NewsGuard	High	High	Formal 0-100 source scoring; rates outlets, not evidence
SRC03	IFCN	High	High	No structured elements in world's dominant fact-checking standard
SRC04	BBC Guidelines	High	Medium-High	Informal source categories, principle-based
SRC05	Verification Handbook	High	High	Principles over frameworks explicitly
SRC06	Bellingcat	Medium-High	Medium	Case-by-case methodology, skill-based

Collection Synthesis¶

Dimension	Assessment
Evidence quality	Robust — primary methodology documents from each organization
Source agreement	High — all sources converge on the principle-based pattern
Source independence	High — six independent organizations with different missions
Outliers	NewsGuard is the only outlier with a genuinely formal scoring system

Detail¶

The evidence converges strongly on a single finding: journalism's approach to truth-seeking is philosophically different from intelligence analysis and science. Where IC and science formalize evaluation into structured instruments (scales, domains, tiers), journalism formalizes principles (fairness, transparency, accuracy) and relies on practitioner judgment for their application. This is not a deficiency — it reflects journalism's different operating constraints (speed, adversarial sources, public accountability).

The one genuine formal system (NewsGuard) is notably a commercial product, not a journalistic standards body. It was designed to rate news websites for platform trust and safety, not for evidence evaluation within journalism.

Gaps¶

Missing Evidence	Impact on Assessment
Internal methodology documents from Reuters, AP, AFP	These wire services may have more structured internal practices than their published guidelines suggest
Practitioner interviews or ethnographic studies	Published methodologies may not capture what journalists actually do — implicit practices may be more structured than documented
Post-2020 methodology updates	The misinformation crisis may have prompted more structured approaches that are not yet published

Researcher Bias Check¶

Declared biases: The researcher's IC framing bias is directly relevant. Evaluating journalism against IC-derived criteria (hierarchical scales, calibrated language, structured domains) inherently frames journalism as "lacking" these elements rather than as having chosen a different approach.

Influence assessment: The finding that journalism lacks formal structured elements could be shaped by asking a question that pre-defines what "structured" means using IC/science terminology. Journalism may have its own forms of structure (editorial review processes, precedent systems, correction policies) that do not map to the four elements specified in the query.

Cross-References¶

Entity	ID	File
Hypotheses	H1, H2, H3	`hypotheses/`
Sources	SRC01, SRC02, SRC03, SRC04, SRC05, SRC06	`sources/`
ACH Matrix	—	ach-matrix.md
Self-Audit	—	self-audit.md