Longterm Wiki

Automation Bias (AI Systems)

EpistemicMedium

Automation bias is the tendency to over-trust automated systems and AI outputs, accepting their conclusions without appropriate scrutiny. Humans are prone to defer to systems that appear authoritative, especially when those systems are usually right. This creates vulnerability when systems are wrong.

Severity
Medium
Likelihood
Very High (occurring)
Time Horizon
~2025
Maturity
Mature

Full Wiki Article

Read the full wiki article for detailed analysis, background, and references.

Read wiki article →

Related Entities3

Sources3

Automation Bias in Decision Making
Parasuraman & Manzey
The Glass Cage
Nicholas Carr
Human Factors research on automation

Assessment

SeverityMedium
LikelihoodVery High (occurring)
Time Horizon~2025
MaturityMature
CategoryEpistemic

Details

TypeEpistemic
StatusWidespread

Tags

human-ai-interactiontrustdecision-makingcognitive-biasai-safety

Quick Links