Skip to content

R0057/2026-04-01/C031/SRC01/E01

Research R0057 — RLHF Yes-Men Claims v3
Run 2026-04-01
Claim C031
Source SRC01
Evidence SRC01-E01
Type Statistical

40% of AI-assisted tasks had zero self-reported critical thinking; 319 knowledge workers surveyed

URL: https://www.microsoft.com/en-us/research/publication/the-impact-of-generative-ai-on-critical-thinking-self-reported-reductions-in-cognitive-effort-and-confidence-effects-from-a-survey-of-knowledge-workers/

Extract

Microsoft Research/CMU surveyed 319 knowledge workers who shared 936 first-hand examples of GenAI use. For 40% of tasks, participants reported using no critical thinking whatsoever. Higher confidence in GenAI correlated with less critical thinking. Published at CHI 2025.

Relevance to Hypotheses

Hypothesis Relationship Strength
H1 Supports Directly addresses claim accuracy
H2 Supports Allows for partial correctness
H3 Contradicts Evidence contradicts material inaccuracy

Context

Published at CHI 2025 (top HCI venue) by Microsoft Research and CMU. Self-reported data has inherent limitations.