Longterm Wiki

Instrumental Convergence

AccidentHigh

Instrumental convergence is the thesis that a wide variety of final goals lead to similar instrumental subgoals. Regardless of what an AI ultimately wants to achieve, it will likely pursue certain intermediate objectives that help achieve any goal.

Severity
High
Likelihood
High (theoretical)
Time Horizon
~2035
Maturity
Mature

Full Wiki Article

Read the full wiki article for detailed analysis, background, and references.

Read wiki article →

Related Entities3

Sources3

Steve Omohundro, 2008
Superintelligence, Chapter 7
Nick Bostrom, 2014

Assessment

SeverityHigh
LikelihoodHigh (theoretical)
Time Horizon~2035
MaturityMature
CategoryAccident

Details

Coined ByNick Bostrom / Steve Omohundro

Tags

power-seekingself-preservationcorrigibilitygoal-stabilityorthogonality-thesis

Quick Links