Skip to content

Q002-S02 — Automation Bias and Overreliance — Search Log

Summary

Field Value
Source/Database Web search (targeted: automation bias, overreliance, NIST, standards)
Query terms Multiple: "automation bias overtrust AI training corporate"; "NIST AI risk management framework confabulation sycophancy"; "Microsoft overreliance AI literature review"
Filters None
Results returned 30 (across 3 searches)
Results selected 4
Results rejected 26

Selected Results

Result Title URL Rationale
S02-R01 Overreliance on AI: Literature Review https://www.microsoft.com/en-us/research/wp-content/uploads/2022/06/Aether-Overreliance-on-AI-Review-Final-6.21.22.pdf Comprehensive review of ~60 papers on overreliance
S02-R02 NIST AI 600-1 https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf Authoritative risk framework; confabulation but not sycophancy
S02-R03 Overreliance on AI: Addressing Automation Bias Today https://www.lumenova.ai/blog/overreliance-on-ai-adressing-automation-bias-today/ 40% zero-scrutiny finding
S02-R04 The Yes-Machine Problem https://www.webpronews.com/the-yes-machine-problem-how-sycophantic-ai-is-becoming-a-safety-crisis-nobody-wants-to-talk-about/ Comprehensive synthesis including regulatory gaps

Rejected Results

Result Title URL Rationale
(26 results) Various Various Not directly about sycophancy warnings in training materials

Notes

The human-factors search (automation bias, overtrust, overreliance) returned more corporate-relevant results than the AI safety search (sycophancy). However, even the automation bias literature focuses on the phenomenon rather than on training programs that address it.