Skip to content

R0050/2026-03-31/Q002 — Assessment

BLUF

Three of the seven examined disciplines contribute concepts genuinely not captured by the nine baseline frameworks: legal evidence law (admissibility gating, adversarial testing, privilege, weight vs. admissibility), engineering safety analysis/FMEA (three-axis risk scoring with detection as a distinct dimension), and historical source criticism (authentication-before-evaluation gating). The remaining four disciplines (Bradford Hill, OCEBM/CASP, auditing, SIFT/CRAAP) have concepts that are already captured through either direct inclusion or close ancestry.

Answer

Rating: H3 (Few novel contributions) · Confidence: High

Confidence rationale: Eight independent sources covering seven disciplines produce a clear two-tier pattern. The novel concepts from legal evidence law and FMEA are unambiguously absent from the nine frameworks. The subsumed status of Bradford Hill, OCEBM, and SIFT/CRAAP is well-established through their historical relationship to GRADE and other frameworks.

Reasoning Chain

  1. Legal standards of proof define a hierarchy of policy-driven probability thresholds (probable cause through beyond reasonable doubt) that differ from ICD 203's epistemic confidence scale. [SRC01-E01, Medium-High reliability, High relevance]

  2. Legal evidence law contributes at least five genuinely novel concepts including admissibility gating, privilege doctrines, adversarial testing, the weight vs. admissibility distinction, and the concept of excluding logically valid reasoning paths for policy reasons. [SRC02-E01, High reliability, High relevance]

  3. PCAOB AS 1105 formalizes evidence sufficiency and appropriateness with context-dependent reliability factors. While well-structured, these concepts parallel GRADE's evidence quality assessment. [SRC03-E01, High reliability, Medium-High relevance]

  4. Bradford Hill's nine viewpoints (1965) are largely subsumed by GRADE and IPCC, which built upon and formalized his insights. [SRC04-E01, Medium-High reliability, High relevance]

  5. FMEA contributes a genuinely novel three-axis scoring methodology (severity x occurrence x detection), with detection probability as a distinct evaluation dimension not present in any of the nine frameworks. [SRC05-E01, Medium reliability, High relevance]

  6. OCEBM's five-level evidence hierarchy is a precursor to GRADE. [SRC06-E01, High reliability, High relevance]

  7. Historical source criticism contributes the authentication-before-evaluation principle — external criticism (is this document genuine?) must pass before internal criticism (is the content true?) begins. [SRC07-E01, Medium-High reliability, High relevance]

  8. SIFT and CRAAP are pedagogical simplifications whose concepts are fully captured by the nine frameworks. [SRC08-E01, Medium reliability, Medium relevance]

  9. JUDGMENT: The two-tier pattern is clear. Disciplines sharing epistemological roots with science (Bradford Hill, OCEBM, CASP, auditing) are already captured. Disciplines with fundamentally different operating constraints (law: procedural fairness; engineering: quantitative risk management; history: document authenticity) contribute novel concepts precisely because they operate under different constraints. [JUDGMENT]

Evidence Base Summary

Source Description Reliability Relevance Key Finding
SRC01 Legal standards of proof Medium-High High Policy-driven probability thresholds
SRC02 Legal evidence concepts High High 5+ genuinely novel concepts
SRC03 PCAOB AS 1105 High Medium-High Sufficiency framework parallels GRADE
SRC04 Bradford Hill criteria Medium-High High Subsumed by GRADE/IPCC
SRC05 FMEA RPN Medium High Novel three-axis scoring with detection
SRC06 OCEBM levels High High Precursor to GRADE
SRC07 Source criticism Medium-High High Authentication-before-evaluation
SRC08 SIFT/CRAAP Medium Medium Pedagogical simplifications

Collection Synthesis

Dimension Assessment
Evidence quality Robust — primary standards documents and authoritative references
Source agreement High — clear convergence on the two-tier pattern
Source independence High — eight independent sources from seven different disciplines
Outliers None — all evidence is consistent with H3

Detail

The strongest finding is the explanatory pattern: why some disciplines contribute novel concepts and others do not. The nine baseline frameworks derive from scientific and intelligence epistemology, which focuses on maximizing epistemic accuracy. Disciplines sharing this goal (epidemiology, EBM, auditing) are naturally captured. Disciplines with additional constraints (law: fairness; engineering: quantitative risk; history: authenticity) contribute novel concepts because those constraints generate evaluation dimensions that pure truth-seeking does not require.

Gaps

Missing Evidence Impact on Assessment
Deep dive into FTA (Fault Tree Analysis) specifically FTA may contribute additional novel concepts beyond FMEA's RPN
CASP checklists detailed analysis CASP's practical implementation may contain nuances not captured by the overview
Legal evidence law across jurisdictions Analysis focused on U.S./common law; civil law traditions may differ
Full Bradford Hill modern reinterpretation literature Modern extensions may contain novel refinements

Researcher Bias Check

Declared biases: Completeness bias directly relevant — the researcher wants to find the nine frameworks sufficient. The finding that most disciplines are already captured could be influenced by this bias.

Influence assessment: The bias is partially mitigated by the clear identification of three disciplines with novel concepts, including one (legal evidence law) with multiple genuinely novel contributions that directly challenge the nine-framework sufficiency claim. The assessment does not suppress contradictory evidence.

Cross-References

Entity ID File
Hypotheses H1, H2, H3 hypotheses/
Sources SRC01, SRC02, SRC03, SRC04, SRC05, SRC06, SRC07, SRC08 sources/
ACH Matrix ach-matrix.md
Self-Audit self-audit.md