C005 — Mulrow 1987: None of 50 Reviews Met All Eight Criteria¶
Research: R0052 Run: 2026-03-31 Mode: claim
BLUF¶
The claim is almost certainly correct. Mulrow's 1987 paper examined 50 review articles and found that none met all eight basic scientific reporting criteria. The paper is a foundational reference in the systematic review literature, and its findings are consistently cited across multiple sources.
Probability / Answer¶
Rating: Almost certain (95-99%) Confidence: High Rationale: Multiple authoritative sources confirm all elements of the claim: 50 reviews examined, eight criteria used, none met all eight. The only element not directly verifiable is the exact publication year — the claim says "as early as 1987" which aligns with the Annals of Internal Medicine publication date.
Reasoning Chain¶
- Mulrow published "The Medical Review Article: State of the Science" in the Annals of Internal Medicine in 1987 (volume 106, pages 485-488). [Source: SRC01, High, High]
- She examined 50 review articles published in four major medical journals during June 1985 to June 1986. [Source: SRC01, High, High]
- Reviews were assessed against eight explicit scientific criteria adapted from published guidelines. [Source: SRC01, High, High]
- Of the 50 articles: 17 satisfied three of the eight criteria; 32 satisfied four or five; 1 satisfied six. None satisfied all eight. [Source: SRC02, High, High]
- The PRISMA statement history page cites Mulrow 1987 as foundational evidence for the need for reporting standards. [Source: SRC03, High, High]
- JUDGMENT: The claim is factually accurate in all respects.
Hypotheses¶
H1: The claim is substantially correct¶
Status: Supported Evidence for: Multiple sources confirm 50 reviews, eight criteria, none meeting all eight. Evidence against: None.
H2: The claim is substantially incorrect¶
Status: Eliminated Evidence for: None. Evidence against: Unanimous confirmation across sources.
H3: The claim is partially correct — numbers or details are slightly off¶
Status: Eliminated Evidence for: None. All specific numbers match. Evidence against: Sources confirm exact counts: 50 reviews, eight criteria, zero meeting all eight.
Evidence Summary¶
| Source | Description | Reliability | Relevance | Key Finding |
|---|---|---|---|---|
| SRC01 | Annals of Internal Medicine — Mulrow 1987 (abstract/citation) | High | High | 50 reviews, eight criteria, none met all eight |
| SRC02 | James Lind Library — Mulrow annotation | High | High | Confirms details and historical significance |
| SRC03 | PRISMA statement history | High | Medium | Cites Mulrow as foundational evidence |
Collection Synthesis¶
| Dimension | Assessment |
|---|---|
| Evidence quality | Robust — primary publication and authoritative secondary sources |
| Source agreement | High — unanimous on all specific claims |
| Source independence | Mixed — secondary sources cite the same primary study |
| Outliers | None |
Gaps¶
| Missing Evidence | Impact on Assessment |
|---|---|
| Full text of Mulrow 1987 | Minimal — abstract and secondary sources provide sufficient detail |
| Exact list of eight criteria | Would strengthen verification but key counts are confirmed |
Researcher Bias Check¶
Declared biases: The researcher uses this finding to argue for better reporting standards. Influence assessment: Low risk — factual claim about a specific historical study.
Revisit Triggers¶
| Trigger | Type | Check |
|---|---|---|
| Correction or erratum to the Mulrow 1987 paper | data | Check Annals of Internal Medicine corrections |
| Reanalysis of Mulrow's original data producing different counts | data | Search for "Mulrow 1987" + "reanalysis" |