C010 — NAS Published 21 Standards with 82 Elements Across Four Stages¶
Research: R0052 Run: 2026-03-31 Mode: claim
BLUF¶
The claim is almost certainly correct. The IOM (now National Academies of Sciences) published "Finding What Works in Health Care: Standards for Systematic Reviews" (2011) with 21 standards and 82 elements of performance organized across four stages of review. All numbers are confirmed by the official publication summary.
Probability / Answer¶
Rating: Almost certain (95-99%) Confidence: High Rationale: The NCBI Bookshelf summary of the IOM report explicitly states "21 standards with 82 elements of performance." The four-stage organization is confirmed by the chapter structure: Initiating (8 standards), Finding/Assessing (6 standards), Synthesizing (4 standards), and Reporting (3 standards) = 21 total.
Reasoning Chain¶
- The NCBI Bookshelf summary states the IOM recommends "21 standards with 82 elements of performance" for systematic reviews. [Source: SRC01, High, High]
- The standards are organized across four stages: Initiating (Chapter 2, 8 standards), Finding and Assessing Individual Studies (Chapter 3, 6 standards), Synthesizing the Body of Evidence (Chapter 4, 4 standards), and The Final Report (Chapter 5, 3 standards). [Source: SRC02, High, High]
- 8 + 6 + 4 + 3 = 21, confirming the total. [Source: SRC02, High, High]
- The publication is formally from the IOM (Institute of Medicine), which is now part of the National Academies of Sciences, Engineering, and Medicine. The claim uses "NAS" which is technically the parent organization. [Source: SRC03, High, Medium]
- JUDGMENT: All specific numbers and the organizational structure are confirmed. The claim is accurate.
Hypotheses¶
H1: The claim is substantially correct¶
Status: Supported Evidence for: Official publication summary confirms 21 standards, 82 elements, and four-stage organization. Evidence against: None.
H2: The claim is substantially incorrect¶
Status: Eliminated Evidence for: None. Evidence against: All numbers confirmed by primary source.
H3: The numbers are correct but the organizational structure differs¶
Status: Eliminated Evidence for: The NCBI introduction mentions "six steps" in the SR process, which could create confusion with the four-stage claim. Evidence against: The six steps describe the SR process itself; the four stages describe how the 21 standards are organized (chapters 2-5). These are different categorizations. The claim refers to the standard organization, which is four stages.
Evidence Summary¶
| Source | Description | Reliability | Relevance | Key Finding |
|---|---|---|---|---|
| SRC01 | NCBI Bookshelf — Finding What Works summary | High | High | "21 standards with 82 elements of performance" |
| SRC02 | NCBI Bookshelf — Chapter summary | High | High | Four stages: 8+6+4+3 = 21 standards |
| SRC03 | National Academies Press catalog | High | Medium | Publication details and context |
Collection Synthesis¶
| Dimension | Assessment |
|---|---|
| Evidence quality | Robust — official publication from National Academies |
| Source agreement | High — all sources agree on numbers |
| Source independence | Low — all sources are from the same publication |
| Outliers | None |
Gaps¶
| Missing Evidence | Impact on Assessment |
|---|---|
| Full text of all 82 elements | Would allow granular verification but summary totals are confirmed |
Researcher Bias Check¶
Declared biases: The researcher's methodology references the NAS standards. Influence assessment: Low risk — factual claim about a specific published report.
Revisit Triggers¶
| Trigger | Type | Check |
|---|---|---|
| Updated NAS standards published (in progress as of 2024) | policy | Check https://www.nationalacademies.org/projects/HMD-HCS-24-06 |
| Erratum or correction to the 2011 report | data | Check National Academies Press |
Additional Observations¶
The National Academies is currently working on "Finding What Works in Health Care: Updating Standards for Systematic Reviews" which may produce a revised set of standards. The current 2011 standards remain the most recent published version.
The claim uses "NAS" (National Academies of Sciences) rather than "IOM" (Institute of Medicine), which was the authoring body. IOM is now part of the National Academies, so "NAS" is a reasonable shorthand, though "IOM" would be more historically precise for attribution.