Skip to content

Q002 — Assessment
Research R0049 — Landscape Scan
Run 2026-03-31-02
Query Q002

BLUF

Very unlikely (05-20%) that a systematic combination of intelligence community analytical standards with scientific methodology frameworks into a single unified methodology has been published. Multiple authors have recognized the parallels and called for bridging (Treverton, Prunckun, Tecuci, Marcoci), but none has produced a unified framework that operationally integrates both traditions. The two domains developed independently with parallel but separate concepts.

Probability Assessment

Hypothesis Probability Assessment
H1 — Unified frameworks exist Very unlikely (05-10%) No evidence found
H2 — Domains remain entirely siloed Unlikely (20-35%) Too absolute; partial bridges exist
H3 — Partial bridges exist, no systematic unification Very likely (85-95%) Strongly supported

Reasoning Chain

  1. Direct search for combinations of ICD 203 with GRADE, PRISMA, Cochrane, or systematic review methodology produced zero results combining both domains (S01 search log).

  2. The closest bridging work is Tecuci et al. (SRC01-E01), which applies the scientific method's hypothesis-testing framework to intelligence analysis using Wigmore chart evidence marshaling. However, Tecuci draws from the legal evidence tradition, not from GRADE/PRISMA/Cochrane.

  3. Prunckun (SRC02-E01) systematically applies scientific methods of inquiry from multiple academic disciplines to intelligence analysis, but draws from social science rather than evidence-based medicine.

  4. Treverton (SRC03-E01), a former NIC Chair, explicitly identifies the divide and calls for bridging through critical reasoning — but does not produce the unified framework.

  5. Marcoci et al. (SRC04-E01) apply scientific experimental methods to evaluate ICD 203 reliability, demonstrating the gap between how science evaluates IC methods versus how IC uses science.

  6. The IC's own foundational documents — Heuer & Pherson's 66 SATs (SRC05-E01) and the CIA Tradecraft Primer (SRC06-E01) — contain no references to GRADE, PRISMA, Cochrane, IPCC, or any scientific evidence synthesis framework.

  7. The parallel concepts are striking but unconnected:

  8. ICD 203 probability language vs. IPCC likelihood scale — both use calibrated words but developed independently
  9. ACH vs. systematic review — both evaluate competing explanations against evidence
  10. IC source reliability ratings vs. GRADE risk of bias — both assess evidence quality
  11. IC tradecraft standards vs. ROBIS domains — both audit analytical process quality

Evidence Base Summary

Source Reliability Relevance Key Finding
SRC01 High High Scientific method applied to IC via Wigmore, not GRADE/PRISMA
SRC02 High High Social science methods for IC, not medical evidence synthesis
SRC03 Medium-High High Calls for bridge, does not build it
SRC04 High Medium-High Scientific evaluation of IC standards
SRC05 High Medium IC methodology self-contained
SRC06 High Medium Baseline IC document, no scientific framework references

Collection Synthesis

Six sources from four independent traditions (IC methodology, scientific evaluation of IC, academic bridging literature, intelligence education) converge on the same finding: the IC and scientific methodology communities share parallel concepts but have not been systematically unified. The bridging that exists is unidirectional (science evaluating/informing IC, not a merger).

Gaps

  1. Classified literature: Unified frameworks may exist in classified IC publications not accessible through web search.
  2. Non-English academic literature: European intelligence agencies (BND, DGSE, GCHQ) may have published unified approaches in their national languages.
  3. Think tank working papers: Some policy/intelligence think tanks may have unpublished working papers on this topic.
  4. IPCC connection: The IPCC uncertainty language framework specifically was not found to have been connected to IC probability language in any publication, though the parallel is obvious.

Researcher Bias Check

  • Motivation bias: The researcher's own methodology claims to derive from both traditions, creating potential motivation to confirm that no prior unification exists. Mitigated by: systematic search design and inclusion of all partial bridging evidence.
  • Familiarity bias: Greater familiarity with IC literature than clinical evidence synthesis literature may have skewed search terms. Mitigated by: searching from both directions.

Cross-References

  • Q001 (system prompts) — The absence of a unified methodology (Q002) partly explains why no complete prompt exists (Q001)
  • Q003 (AI research tools) — Tools implement features from one tradition or the other, not a unified approach