Skip to content
Longterm Wiki

Open Philanthropy: AI Impacts General Support 2020 Grant

web

Credibility Rating

4/5
High(4)

High quality. Established institution or organization with editorial oversight and accountability.

Rating inherited from publication venue: Coefficient Giving

This is Open Philanthropy's grant page for AI Impacts' 2020 general support, part of their broader Transformative AI program funding technical safety, governance, and capacity building.

Metadata

Importance: 35/100homepage

Summary

This page describes Open Philanthropy's Transformative AI funding program, which has made 480+ grants supporting technical AI safety research, AI governance and policy, and capacity building. The 2020 grant to AI Impacts falls under this broader initiative to reduce global catastrophic risks from advanced AI. The program supports work on alignment, governance frameworks, and growing the field of AI safety researchers.

Key Points

  • Open Philanthropy has made 480+ grants under its Transformative AI program covering technical safety, governance, and capacity building.
  • The program funds AI Impacts, an organization that researches AI timelines and forecasting relevant to AI safety planning.
  • Funding areas include technical AI safety research, AI governance/policy frameworks, and career development for safety researchers.
  • Program leads include Claire Zabel, Luke Muehlhauser, Peter Favaloro, and Eli Rose across different focus areas.
  • Open RFPs exist for AI governance, capacity building, and career development/transition funding.

Cached Content Preview

HTTP 200Fetched Apr 27, 20265 KB
Navigating Transformative AI

 
 Though advances in AI could benefit people enormously, we think they also pose serious risks from misuse, accidents, loss of control, and other problems. 

 
 
 
 
 
 
 
 480+ 
 grants made 
 

 
 
 
 
 
 Contents

 
 About the Fund 

 Funding Opportunities 

 Research & Updates 

 Featured Grants 

 
 
 
 
 
 
 
 
 
 
 

 About the Fund

 
 
 

 Program Leads

 
 
 
 
 
 
 
 
 
 Claire Zabel 
 Managing Director, Short Timelines Special Projects

 
 

 
 
 
 
 
 
 
 Luke Muehlhauser 
 Managing Director, AI Governance & Policy

 
 

 
 
 
 
 
 
 
 Peter Favaloro 
 Program Director, Technical AI Safety

 
 

 
 
 
 
 
 
 
 Eli Rose 
 Program Director, Global Catastrophic Risks Capacity Building

 
 

 
 
 
 

 Partners

 
 
 
 
 Good Ventures 

 
 Interested in providing funding within this space? Reach out to partnerwithus@coefficientgiving.org .

 

 
 
 
 

 
 In recent years, we’ve seen rapid progress in artificial intelligence. There’s a strong possibility that AI systems will soon outperform humans in nearly all cognitive domains. 

 We think AI could be the most important technological development in human history. If handled well, it could accelerate scientific discovery , improve health outcomes , and create unprecedented prosperity . If handled poorly, it could lead to catastrophic consequences: many experts think that risks from AI-related misuse, loss of control, or drastic societal change could endanger human civilization. 

 To reduce the risk of global catastrophe and help society prepare for major advances in AI, we support: 

 
 Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned 

 AI governance and policy work to develop frameworks for safe, secure, and responsibly managed AI development 

 Capacity building to grow and strengthen the field of researchers and practitioners working on these challenges

 New projects  that we expect to be particularly impactful if timelines to transformative AI are short
 
 
 
 
 
 
 
 
 
 
 
 

 

 

 
 

 
 
 
 
 
 Funding Opportunities

 
 
 Prev 
 
 
 Next 
 
 
 

 
 
 

 
 
 Request for Proposals

 
 
 
 
 AI Governance
 
 
 
 

 
 
 

 
 This program provides support for projects that aim to improve the odds of humanity successfully navigating the risks of transformative AI. We are primarily seeking expressions of interest in the following areas: technical AI governance, policy development, strategic analysis and threat modeling, frontier company policy, international AI governance, and law.

 
 

 
 Learn more and apply
 
 

 

 
 
 

 

 
 
 Request for Proposals

 
 
 
 
 Funding for Work That Builds Capacity To Address Risks From Transformative AI
 
 
 
 

 
 
 

 
 This program funds projects that build society’s capacity to navigate the risks of transformative AI. We’re especially interested in funding projects that help new talent pivot into the field, support existing talent (e.g. v

... (truncated, 5 KB total)
Resource ID: 288468825ad09d54 | Stable ID: sid_eMQNrq788g