Skip to content

R0055/2026-04-01/C018/SRC01/E01

Research R0055 — RLHF Yes-Men Claims
Run 2026-04-01
Claim C018
Source SRC01
Evidence SRC01-E01
Type Statistical

Self-reported: 40% of tasks used zero critical thinking (not 40% of users)

URL: https://dl.acm.org/doi/full/10.1145/3706598.3713778

Extract

Microsoft Research and CMU surveyed 319 knowledge workers and collected 936 real-world GenAI usage examples. Participants stated that for 40% of their tasks they used no critical thinking whatsoever when using AI. This is 40% of tasks, not 40% of users. Higher AI confidence correlated with less critical thinking. Published at CHI 2025.

Relevance to Hypotheses

Hypothesis Relationship Strength
H1 Supports Moderate
H2 Supports Strong
H3 Contradicts Strong

Context

Evidence directly relevant to testing the claim's factual assertions.