Skip to content

R0002/2026-03-13/C009 — Assessment
Research R0002 — Research Standards for AI-Assisted Writing
Run 2026-03-13
Claim C009

BLUF

Confirmed. The IOM (operating under the National Academies) published "Finding What Works in Health Care: Standards for Systematic Reviews" (2011) containing 21 standards with 82 elements of performance across four stages of the systematic review process. The "NAS" attribution is colloquially acceptable but technically imprecise -- the publishing body was the IOM.

Probability

Rating: Almost certain (97%)

Confidence in assessment: High

Confidence rationale: The primary source text (NCBI Bookshelf) explicitly states "21 standards with 82 elements of performance." The four stages are itemized with standard counts that sum to 21 (8+6+4+3). No source disputes any numerical claim. The only minor issue is the NAS/IOM attribution.

Reasoning Chain

  1. The claim states "NAS published 21 standards with 82 elements across four stages for systematic reviews." [Claim text]
  2. The report is titled "Finding What Works in Health Care: Standards for Systematic Reviews" (2011), published by the Institute of Medicine (IOM). [SRC01-E01, High reliability, High relevance]
  3. The IOM operates under the National Academies of Sciences, Engineering, and Medicine. The "NAS" attribution is colloquially acceptable. [SRC01-E01, SRC03-E01]
  4. The NCBI Bookshelf summary explicitly states: "The committee recommends 21 standards with 82 elements of performance." [SRC02-E01, High reliability, High relevance]
  5. The four stages are: (1) Initiating the SR Process (8 standards), (2) Finding and Assessing Individual Studies (6 standards), (3) Synthesizing the Body of Evidence (4 standards), (4) The Final Report (3 standards). Sum: 8+6+4+3 = 21. [SRC01-E02]
  6. Inference: All numerical sub-claims are confirmed by the primary source. The only imprecision is the publisher attribution.
  7. Conclusion: Rating of "Almost certain" reflects unambiguous primary source confirmation of all numerical claims.

Evidence Base Summary

Source Description Reliability Relevance Key Finding
SRC01 IOM Finding What Works High High Published by IOM; four stages with itemized standard counts
SRC02 NCBI NBK209513 High High Explicit "21 standards with 82 elements" quote
SRC03 NAP Catalog High Medium Catalog confirms report existence and publisher

Collection Synthesis

Dimension Assessment
Evidence quality High -- primary source text with explicit numerical confirmation
Source agreement Full agreement on all numerical claims
Source independence High -- NCBI (government), NAP (publisher), and PubMed provide separate confirmation paths
Outliers None

Detail

All sources agree on the factual claims. The NCBI Bookshelf provides the explicit quote confirming both 21 standards and 82 elements. The NAP front matter provides the four-stage breakdown with standard counts per stage. The arithmetic sum (8+6+4+3=21) serves as an independent verification. There is no dispute in the evidence base. The report's table of contents shows five chapters, but the standards framework uses four stages -- this distinction was investigated and resolved.

Gaps

# Missing Evidence Impact on Assessment
1 NAS committee currently updating standards Low impact on current claim; may affect future accuracy
2 Individual element counts per standard not verified Low impact -- the total of 82 is confirmed by explicit quote

The NAS has convened a committee to update these standards. The 2011 framework may be superseded in the future, similar to how CONSORT 2025 superseded CONSORT 2010. This does not affect the current assessment but establishes a revisit trigger.

Researcher Bias Check

Declared biases: Author has incentive for claims to be accurate (confirmation bias risk). Potential for conflating NAS with IOM/NAM.

Influence assessment: Minimal risk. The claim is straightforwardly factual and the evidence is unambiguous. The attribution nuance (IOM vs NAS) was identified and reported transparently despite the author's incentive to confirm the claim without caveats.

Cross-References

Entity ID File
Hypotheses H1, H2, H3 hypotheses/
Sources SRC01, SRC02, SRC03 sources/
ACH Matrix 009 ach-matrix.md
Self-Audit 009 self-audit.md