R0050/2026-03-31/Q001/SRC01/E02¶
PolitiFact's methodology contains no formal evidence hierarchy, no structured bias assessment framework, and no source reliability tiering.
URL: https://www.politifact.com/article/2018/feb/12/principles-truth-o-meter-politifacts-methodology-i/
Extract¶
Per the WebFetch analysis of the PolitiFact methodology page:
-
Evidence hierarchy: "No formal hierarchical scale exists for evidence quality." However, PolitiFact demonstrates implicit prioritization: primary sources over secondary sources, independent verification over campaign statements, direct documentation over media reports citing unnamed sources.
-
Bias assessment: "No structured bias assessment framework is described." PolitiFact relies on journalist ethics policies (prohibiting political contributions, campaign work, public political expression), editorial review by three editors, and consideration of "jurisprudence."
-
Source reliability tiering: "Formal tiering is absent." The methodology emphasizes on-the-record sourcing and publishing source lists with fact-checks, allowing readers to judge credibility independently.
-
Uncertainty language: The six Truth-O-Meter ratings provide graduated language but it rates claim accuracy, not the fact-checker's own uncertainty.
Relevance to Hypotheses¶
| Hypothesis | Relationship | Strength |
|---|---|---|
| H1 | Contradicts | Three of four structured elements are absent from PolitiFact |
| H2 | Supports | PolitiFact lacks most of the structured elements |
| H3 | Supports | Implicit versions exist (source preference, editorial review) but are not formalized |
Context¶
PolitiFact's approach exemplifies the journalistic tradition of relying on editorial judgment and practitioner expertise rather than formalized scoring frameworks. The three-editor review process provides a form of quality control, but it operates through deliberation and consensus rather than structured evaluation criteria.