R0002/2026-03-13/C008 — Assessment¶
BLUF¶
Confirmed. ROBIS assesses four domains of bias in systematic reviews: (1) study eligibility criteria, (2) identification and selection of studies, (3) data collection and study appraisal, and (4) synthesis and findings. These are specifically the Phase 2 domains within a three-phase assessment tool.
Probability¶
Rating: Almost certain (97%)
Confidence in assessment: High
Confidence rationale: The primary publication (Whiting et al., 2016) and the institutional tool host (University of Bristol) both explicitly confirm four Phase 2 domains. No source disputes this count. The only nuance is structural -- the four domains exist within a three-phase tool -- but this does not affect the claim's accuracy.
Reasoning Chain¶
- The claim states "ROBIS assesses four domains of bias in systematic reviews." [Claim text]
- The primary publication (PMC4687950) explicitly states: "Phase 2 covers four domains through which bias may be introduced into a systematic review." [SRC01-E01, High reliability, High relevance]
- The four domains are named: study eligibility criteria, identification and selection of studies, data collection and study appraisal, synthesis and findings. [SRC01-E01]
- The University of Bristol ROBIS tool page confirms the same four-domain structure. [SRC02-E01, High reliability, High relevance]
- ROBIS has three phases total (Phase 1: relevance, Phase 2: four domains, Phase 3: overall risk of bias). The claim focuses on Phase 2 only. [SRC01-E02]
- Inference: The claim is accurate. The four domains are the core of the ROBIS tool and the most commonly referenced feature. Focusing on them is appropriate even though the full tool has three phases.
- Conclusion: Rating of "Almost certain" reflects strong, unambiguous evidence from primary and institutional sources.
Evidence Base Summary¶
| Source | Description | Reliability | Relevance | Key Finding |
|---|---|---|---|---|
| SRC01 | ROBIS (Whiting 2016) | High | High | Four Phase 2 domains confirmed; three-phase structure noted |
| SRC02 | Bristol ROBIS Tool | High | High | Institutional confirmation of four-domain structure |
| SRC03 | PubMed ROBIS | High | Medium | Publication existence and peer review status confirmed |
Collection Synthesis¶
| Dimension | Assessment |
|---|---|
| Evidence quality | High -- primary publication and institutional source |
| Source agreement | Full agreement on domain count and names |
| Source independence | Moderate -- primary publication and institutional page share authorship, but PubMed provides independent confirmation |
| Outliers | None |
Detail¶
All sources agree on the four-domain structure in Phase 2. There is no dispute in the evidence base. The only analytical nuance is whether "four domains" is a complete characterization of ROBIS (it is not -- the tool has three phases), but this is a matter of completeness rather than accuracy. The claim is correct as stated.
Gaps¶
| # | Missing Evidence | Impact on Assessment |
|---|---|---|
| 1 | Whether ROBIS has been updated since 2016 | Low impact -- no evidence of updates found, and tool page is current |
No significant gaps. The evidence base is sufficient for a high-confidence assessment.
Researcher Bias Check¶
Declared biases: Author has incentive for claims to be accurate (confirmation bias risk).
Influence assessment: Minimal risk. The claim is straightforwardly factual and the evidence is unambiguous. No judgment calls were required that could be influenced by confirmation bias.
Cross-References¶
| Entity | ID | File |
|---|---|---|
| Hypotheses | H1, H2, H3 | hypotheses/ |
| Sources | SRC01, SRC02, SRC03 | sources/ |
| ACH Matrix | 008 | ach-matrix.md |
| Self-Audit | 008 | self-audit.md |