R0002/2026-03-13/C011 — Assessment¶
BLUF¶
Partially confirmed. The specific absences claimed (formal evidence hierarchies, calibrated uncertainty scales, structured bias assessment domains) are well-supported — no journalism or fact-checking framework was found that includes these features as formally defined in clinical research or intelligence analysis. However, the binary framing of "principles-based, not methodology-based" oversimplifies. Fact-checking organizations do have published methodologies, verification procedures, and structured rating scales.
Probability¶
Rating: Likely (68%)
Confidence in assessment: Medium
Confidence rationale: The specific absences (sub-claims 011b, 011c, 011d) are supported with high confidence. The principles-vs-methodology framing (sub-claim 011a) introduces uncertainty because the binary oversimplifies. Journalism textbooks and investigative journalism manuals were not searched, which could contain more structured frameworks.
Reasoning Chain¶
- The claim asserts journalism and fact-checking are "principles-based, not methodology-based" and lack three specific formal features. [Claim text]
- The SPJ Code of Ethics is explicitly "not a set of rules, rather a guide" with voluntary principles and no enforcement. [SRC01-E01, High reliability, High relevance]
- The SPJ Code contains no evidence hierarchies, uncertainty scales, or bias assessment domains. [SRC01-E02, absence confirmed]
- The IFCN Code of Principles establishes five commitments, including requiring published methodology from signatories. [SRC02-E01, High reliability, High relevance]
- Inference: The IFCN's methodology requirement contradicts the "purely principles-based" characterization. Fact-checking has methodological elements within a principles framework.
- Despite methodological elements, the IFCN code lacks formal evidence hierarchies, uncertainty scales, or bias assessment domains. [SRC02-E02]
- Academic research confirms fact-checking has a "contested epistemology" (Graves, 2017) — the field lacks settled methodological foundations. [SRC04-E01, High reliability]
- A 2025 epistemological framework paper suggests the field is still developing its foundations. [SRC03-E01]
- The IC's ICD 203 defines calibrated probability language with explicit ranges — journalism has no equivalent. [SRC05-E01, High reliability]
- Conclusion: Sub-claims 011b (evidence hierarchies), 011c (uncertainty scales), and 011d (bias assessment domains) are well-supported. Sub-claim 011a (principles-vs-methodology) is directionally correct but oversimplified. The claim would be more accurate stated as: "Journalism and fact-checking lack formal evidence hierarchies, calibrated uncertainty scales, and structured bias assessment domains comparable to those in clinical research and intelligence analysis, though they do maintain verification methodologies and ethical principles."
Evidence Base Summary¶
| Source | Description | Reliability | Relevance | Key Finding |
|---|---|---|---|---|
| SRC01 | SPJ Code of Ethics | High | High | SPJ code is principles-based, voluntary, lacks all three features |
| SRC02 | IFCN Code of Principles | High | High | IFCN requires methodology but lacks the three specific features |
| SRC03 | Epistemological Framework 2025 | High | Medium | Field still developing epistemological foundations |
| SRC04 | Graves 2017 Contested Epistemology | High | High | "Contested epistemology" — no settled foundations |
| SRC05 | ICD 203 Analytic Standards | High | Medium | IC comparator confirms what calibrated uncertainty looks like |
Collection Synthesis¶
| Dimension | Assessment |
|---|---|
| Evidence quality | Medium-high — professional codes and academic research |
| Source agreement | Medium — agree on specific absences, partially disagree on methodology characterization |
| Source independence | High — SPJ, IFCN, academic researchers, government directive |
| Outliers | PolitiFact Truth-O-Meter and similar scales as proto-structured tools |
Detail¶
Sources converge on the finding that journalism and fact-checking lack the three specific formal features named in the claim. Where they diverge is on the principles-vs-methodology characterization: the SPJ Code is unambiguously principles-based, but the IFCN requires methodology, and fact-checking organizations use verification procedures and structured rating scales. Graves' "contested epistemology" characterization captures this tension well — methodological elements exist but lack the settled, formal foundations found in clinical research and intelligence analysis.
Gaps¶
| # | Missing Evidence | Impact on Assessment |
|---|---|---|
| 1 | Journalism education textbooks | Could contain structured methodological frameworks |
| 2 | IRE investigative resources | May have more structured approaches |
| 3 | Emerging epistemological work | 2025 paper suggests active development |
The search comprehensiveness concern is the primary gap. Journalism textbooks and investigative journalism manuals were not searched. These resources might contain more structured methodological frameworks than professional codes and academic papers reveal. The field is actively evolving — the 2025 epistemological framework paper suggests ongoing development.
Researcher Bias Check¶
Declared biases: Author has anti-social-media bias and is constructing an argument for the hybrid prompt's novelty. Incentive to portray journalism/ fact-checking as less rigorous than IC/scientific methods.
Influence assessment: The bias risk was mitigated by the search design — complicating evidence (IFCN methodology requirement, verification procedures, rating scales) was found and incorporated into the assessment. The synthesis does not simply confirm the claim but identifies where it oversimplifies. The "partially confirmed" verdict reflects balanced treatment of the evidence.
Cross-References¶
| Entity | ID | File |
|---|---|---|
| Hypotheses | H1, H2, H3 | hypotheses/ |
| Sources | SRC01 through SRC05 | sources/ |
| ACH Matrix | C011 | ach-matrix.md |
| Self-Audit | C011 | self-audit.md |