Skip to content

R0057/2026-04-01/C031/SRC01

Research R0057 — RLHF Yes-Men Claims v3
Run 2026-04-01
Claim C031
Search S01
Result S01-R01
Source SRC01

Lee et al. (2025) Microsoft Research/CMU

Source

Field Value
Title The Impact of Generative AI on Critical Thinking
Publisher CHI 2025 / Microsoft Research
Author(s) Lee et al. (Microsoft Research / CMU)
Date 2024-2026
URL https://www.microsoft.com/en-us/research/publication/the-impact-of-generative-ai-on-critical-thinking-self-reported-reductions-in-cognitive-effort-and-confidence-effects-from-a-survey-of-knowledge-workers/
Type Research paper (peer-reviewed)

Summary

Dimension Rating
Reliability High
Relevance High
Bias: Missing data Low risk
Bias: Measurement Low risk
Bias: Selective reporting Low risk
Bias: Randomization N/A — not an RCT
Bias: Protocol deviation N/A — not an RCT
Bias: COI/Funding Low risk

Rationale

Dimension Rationale
Reliability Research paper (peer-reviewed) from established institution/publication
Relevance Directly addresses the claim under investigation
Bias flags No significant bias concerns identified

Evidence Extracts

Evidence ID Summary
SRC01-E01 40% of AI-assisted tasks had zero self-reported critical thinking; 319 knowledge workers surveyed