Q001 — Query Definition¶


Research	R0051 — Fact-Checking Gap
Run	2026-03-31
Query	Q001

Query as Received¶

Has the fact-checking community developed any formal epistemological framework for evidence evaluation comparable to GRADE (certainty of evidence), IPCC (calibrated uncertainty language), or ICD 203 (analytical tradecraft standards)? Search across academic literature on fact-checking methodology, computational fact-checking pipelines, and practitioner publications.

Query as Clarified¶

This query asks whether the journalistic and computational fact-checking communities have developed any structured, formal framework for evaluating the quality and certainty of evidence — one that provides hierarchical evidence quality scales, calibrated uncertainty language, structured bias assessment protocols, or source reliability tiering comparable to frameworks used in medicine (GRADE), climate science (IPCC), or intelligence analysis (ICD 203). The search spans three domains: academic scholarship on fact-checking methodology, computational/automated fact-checking systems, and practitioner-facing publications from fact-checking organizations.

Embedded assumptions surfaced: - Assumes GRADE, IPCC, and ICD 203 represent the relevant comparison class (JUDGMENT: reasonable, these are the most widely recognized formal evidence evaluation frameworks). - Assumes the fact-checking community is a coherent enough entity to have "developed" something collectively.

BLUF¶

No formal epistemological framework comparable to GRADE, IPCC, or ICD 203 exists within the fact-checking community. Academic literature has produced epistemological analyses of fact-checking (Vandenberghe 2025, Uscinski & Butler 2013) and practitioner organizations have established codes of principles (IFCN), but none of these constitute a structured, operationalized evidence evaluation framework with hierarchical quality scales, calibrated confidence language, or systematic bias assessment.

Scope¶

Domain: Fact-checking methodology — journalistic, computational, and practitioner domains
Timeframe: All available literature, with emphasis on 2013-2026
Testability: Search for published frameworks, specifications, or standards documents that provide structured evidence evaluation methodology within fact-checking

Assessment Summary¶

Probability: N/A (open-ended query)

Confidence: High

Hypothesis outcome: H2 (partial frameworks exist but none comparable to GRADE/IPCC/ICD 203) is best supported. Individual components exist in isolation — epistemological analysis, codes of conduct, credibility indicators — but no integrated, operationalized framework.

[Full assessment in assessment.md.]

Status¶

Field	Value
Date created	2026-03-31
Date completed	2026-03-31
Researcher profile	Not provided
Prompt version	Unified Research Methodology v1
Revisit by	2027-03-31
Revisit trigger	Publication of a formal evidence evaluation standard by IFCN, EFCSN, or a major academic consortium