R0002/2026-03-13/C011 — Self-Audit¶
Summary¶
| Domain | Rating |
|---|---|
| Eligibility criteria | Low risk |
| Search comprehensiveness | Some concerns |
| Evaluation consistency | Low risk |
| Synthesis fairness | Low risk |
Overall risk of bias: Low-to-moderate
Detail¶
Eligibility Criteria¶
Rating: Low risk
Clear criteria established for each sub-claim. Sources included if they directly addressed journalism or fact-checking principles, codes, methodology, evidence hierarchies, uncertainty scales, or bias assessment frameworks. No borderline decisions were required.
Search Comprehensiveness¶
Rating: Some concerns
Five searches conducted targeting the SPJ Code, IFCN Code, journalism epistemology, fact-checking methodology, and the ICD 203 comparator. However, journalism education textbooks and investigative journalism manuals (e.g., IRE resources) were not searched. These could contain more structured methodological frameworks not visible in professional codes and academic papers. The 2025 epistemological framework paper suggests active development in this area.
Evaluation Consistency¶
Rating: Low risk
All sources evaluated using the same scorecard dimensions. The IFCN source — which complicates the claim by requiring published methodology — was given the same High reliability rating as the SPJ source that supports the claim. No differential treatment of supporting vs complicating evidence.
Synthesis Fairness¶
Rating: Low risk
The synthesis clearly identifies where the claim oversimplifies (principles- vs-methodology binary) while confirming the specific absences. The claim is not simply marked "wrong" — it is marked as partially confirmed with the specific absences well-supported but the framing oversimplified. The nuance is preserved.
Flags¶
| # | Flag | Impact |
|---|---|---|
| 1 | Journalism textbooks not searched | Could contain structured methodological frameworks |
| 2 | IRE investigative resources not searched | May have more structured approaches for investigative journalism |
| 3 | Author has anti-social-media bias | Incentive to portray journalism as less rigorous than IC/scientific methods |