Back
Slatestar Codex: Meditations on Moloch
webslatestarcodex.com·slatestarcodex.com/2014/07/30/meditations-on-moloch/
A seminal long-form essay widely read in the AI safety and rationalist communities; frequently cited as an accessible conceptual framing for why misaligned optimization processes—including misaligned AI—pose civilizational risks.
Metadata
Importance: 88/100blog postanalysis
Summary
Scott Alexander's influential essay uses Allen Ginsberg's poem as a metaphor to explore how multipolar traps, coordination failures, and misaligned incentive structures lead rational actors to collectively produce catastrophic outcomes. The essay argues that humanity's greatest challenge is the emergence of optimization processes—markets, evolution, governments, AI—that pursue goals misaligned with human values, and that building 'Moloch-resistant' coordination mechanisms is essential for survival.
Key Points
- •Multipolar traps (races to the bottom, prisoners' dilemmas) cause groups of rational agents to converge on outcomes that are bad for all participants.
- •Many societal ills—environmental destruction, arms races, overwork—stem from coordination failures where defection is individually rational but collectively catastrophic.
- •Sufficiently powerful optimization processes (including AI) can destroy human values as a side effect of pursuing misaligned goals.
- •The essay frames AI alignment as a special case of the broader problem of creating entities that optimize for human values rather than proxies.
- •Alexander argues that a 'friendly' superintelligence could be the only entity capable of enforcing coordination at sufficient scale to defeat Moloch.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| Multipolar Trap (AI Development) | Risk | 91.0 |
Cached Content Preview
HTTP 200Fetched Apr 9, 202698 KB
Meditations On Moloch | Slate Star Codex
Home
About / Top Posts
Archives
Top Posts
Comments Feed
RSS Feed
Slate Star Codex
Blogroll
Economics
Artir Kel
Bryan Caplan
David Friedman
Pseudoerasmus
Scott Sumner
Tyler Cowen
Effective Altruism
80000 Hours Blog
Effective Altruism Forum
GiveWell Blog
Rationality
Alyssa Vance
Beeminder
Elizabeth Van Nostrand
Gwern Branwen
Jacob Falkovich
Jeff Kaufman
Katja Grace
Kelsey Piper
Less Wrong
Paul Christiano
Robin Hanson
Sarah Constantin
Zack Davis
Zvi Mowshowitz
Science
Andrew Gelman
Greg Cochran
Michael Caton
Razib Khan
Scott Aaronson
Stephan Guyenet
Steve Hsu
SSC Elsewhere
SSC Discord Server
SSC Podcast
SSC Subreddit
Unsong
Archives
January 2021
September 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
Full Archives
Meditations On Moloch
Posted on July 30, 2014 by Scott Alexander
I.
Allen Ginsberg’s famous poem on Moloch:
What sphinx of cement and aluminum bashed open their skulls and ate up their brains and imagination?
Moloch! Solitude! Filth! Ugliness! Ashcans and unobtainable dollars! Children screaming under the stairways! Boys sobbing in armies! Old men weeping in the parks!
Moloch! Moloch! Nightmare of Moloch! Moloch the loveless! Mental Moloch! Moloch the heavy judger of men!
Moloch the incomprehensible prison! Moloch the crossbone soulless jailhouse and Congress of
... (truncated, 98 KB total)Resource ID:
c1ea94e3153eee62 | Stable ID: sid_0wb8U4f9pr