Back
AI Impacts Reanalysis
webAuthors
Ben Weinstein-Raun·Substack·Substack
Credibility Rating
3/5
Good(3)Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.
Rating inherited from publication venue: AI Impacts
This reanalysis is relevant for researchers interpreting expert consensus on AI timelines and risks, building on the influential 2023 AI Impacts survey that polled hundreds of ML researchers on transformative AI expectations.
Metadata
Importance: 55/100blog postanalysis
Summary
Tom Adamczewski reexamines the 2023 AI Impacts Expert Survey on Progress in AI, applying improved data analysis methods and enhanced visualizations. The reanalysis provides an open-source codebase to enable reproducibility and further exploration of the survey data. It offers a deeper look at expert predictions regarding AI timelines and transformative AI risks.
Key Points
- •Reanalyzes the widely-cited 2023 AI Impacts Expert Survey on Progress in AI with enhanced statistical methods.
- •Provides improved data visualizations to better communicate expert opinion distributions on AI timelines and risks.
- •Releases an open-source codebase to support reproducibility and community exploration of the survey findings.
- •Offers a more nuanced picture of expert beliefs about transformative AI and potential existential risk timelines.
- •Complements the original survey by surfacing patterns or insights that may not have been prominent in the initial analysis.
Review
The reanalysis of the 2023 AI Expert Survey represents an important methodological contribution to understanding expert perspectives on AI development and potential timelines. By introducing improved data visualization techniques and making the analysis process transparent through an open-source codebase, the report enhances our ability to interpret complex expert survey data on artificial intelligence progress and potential future scenarios.
The work is significant for the AI safety community as it demonstrates the importance of rigorous, reproducible analysis of expert opinions. By providing a more nuanced and transparent approach to interpreting survey data, the reanalysis helps researchers and policymakers better understand the range of expert perspectives on AI development, potential risks, and future trajectories. The open-source nature of the analysis also allows for further scrutiny and independent verification, which is crucial in a rapidly evolving field like AI research.
Cached Content Preview
HTTP 200Fetched Apr 9, 20263 KB
Reanalyzing the 2023 Expert Survey on Progress in AI AI Impacts blog Subscribe Sign in Reanalyzing the 2023 Expert Survey on Progress in AI With new charts, and a newly open-source codebase Ben Weinstein-Raun Dec 16, 2024 6 Share An illustration of the central range of expert responses, when asked about the timeline of automating all human labor. There’s a new report on the AI Impacts web site, that focuses on reanalyzing the data from the 2023 Expert Survey on Progress in AI (originally written up in Thousands of AI Authors on the Future of AI ). A (mostly) analogous chart to the above, this one from the original paper The report, by Tom Adamczewski , introduces several improvements over the earlier analysis. Even better, it comes with a brand new open-source codebase , also by Tom, that anyone can use to perform their own analyses on the data. I found the report illuminating, and I recommend it to anyone interested in the tradeoffs and options available in eliciting, analyzing, and presenting quantitative estimates from experts. Plus there are many excellent new graphs! 6 Share Discussion about this post Comments Restacks Top Latest Discussions No posts Ready for more? Subscribe © 2026 AI Impacts · Privacy ∙ Terms ∙ Collection notice Start your Substack Get the app Substack is the home for great culture This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts
Resource ID:
f23914664a3c2379 | Stable ID: sid_qJ6yWO4SbF