C001 — Self-Audit¶


Research	R0052 — Methodology Claims
Run	2026-03-31
Claim	C001

ROBIS 4-Domain Audit¶

Domain 1: Eligibility Criteria¶

Rating: Low risk

Criterion	Assessment
Criteria defined before searching	Yes — looking for official ICD 203 documentation and secondary analyses
Criteria consistent throughout	Yes — did not shift after seeing results

Notes: Eligibility criteria were straightforward: primary or authoritative secondary sources that enumerate the ICD 203 tradecraft standards.

Domain 2: Search Comprehensiveness¶

Rating: Low risk

Criterion	Assessment
Multiple search strategies used	Yes — two searches with different query formulations
Searches designed to test each hypothesis	Yes — searched for both confirming and contradicting evidence
All results dispositioned	Yes — 20 results returned, all dispositioned
Source diversity achieved	Yes — government, military, private sector sources

Notes: 2 searches, 20 total results, 5 selected, 15 rejected.

Domain 3: Evaluation Consistency¶

Rating: Low risk

Criterion	Assessment
All sources scored using same framework	Yes
Evidence typed consistently	Yes
ACH matrix applied	Yes
Diagnosticity analysis performed	Yes

Notes: All three sources scored consistently. The claim is factual and straightforward.

Domain 4: Synthesis Fairness¶

Rating: Low risk

Criterion	Assessment
All hypotheses given fair hearing	Yes — H2 and H3 considered despite strong H1 evidence
Contradictory evidence surfaced	No contradictory evidence found despite searching
Confidence calibrated to evidence	Yes
Gaps acknowledged	Yes — PDF parsing failure noted

Notes: The absence of any contradictory evidence is itself notable and was considered.

Domain 5: Source-Back Verification¶

Rating: Low risk

Source	Claim in Assessment	Source Actually Says	Match?
SRC01	ICD 203 mandates nine tradecraft standards	ICD 203 states products must "implement and exhibit" nine Analytic Tradecraft Standards	Yes
SRC02	Ford lists all nine standards by name	Ford enumerates nine standards with descriptions	Yes
SRC03	Army confirms nine standards	Military Review discusses nine tradecraft standards for Army application	Yes

Discrepancies found: 0

Corrections applied: None needed

Unresolved flags: None

Notes: All three sources consistently confirm the nine-standard count. Standard #9 (Visual Incorporation) is sometimes described differently across sources but all count nine total.

Overall Assessment¶

Overall risk of bias: Low risk

This is a factual claim about a specific government document. The evidence is consistent and comes from diverse, independent sources.

Researcher Bias Check¶

Confirmation bias (low risk): The researcher favors IC frameworks, but this claim is a factual count verifiable against the document. The bias does not meaningfully affect the assessment.
Anchoring bias (low risk): The number "nine" was given in the claim. Searches were designed to find the actual count, not just confirm nine.