Instrumental Convergence
AccidentHighInstrumental convergence is the thesis that a wide variety of final goals lead to similar instrumental subgoals. Regardless of what an AI ultimately wants to achieve, it will likely pursue certain intermediate objectives that help achieve any goal.
Severity
High
Likelihood
High (theoretical)
Time Horizon
~2035
Maturity
Mature
Full Wiki Article
Read the full wiki article for detailed analysis, background, and references.
Read wiki article →Related Entities3
Sources3
Steve Omohundro, 2008
Superintelligence, Chapter 7
Nick Bostrom, 2014
Turner et al.
Assessment
SeverityHigh
LikelihoodHigh (theoretical)
Time Horizon~2035
MaturityMature
CategoryAccident
Details
Coined ByNick Bostrom / Steve Omohundro
Tags
power-seekingself-preservationcorrigibilitygoal-stabilityorthogonality-thesis