Longterm Wiki

AI-Augmented Forecasting

AI-augmented forecasting combines the pattern-recognition and data-processing capabilities of AI systems with the contextual judgment and calibration of human forecasters. This hybrid approach aims to produce more accurate predictions about future events than either humans or AI alone, particularly for questions relevant to policy and risk assessment. Current systems take several forms. AI can aggregate and weight forecasts from many human predictors, adjusting for individual track records and biases. AI can assist forecasters by synthesizing relevant information, identifying base rates, and flagging considerations that might otherwise be missed. More ambitiously, AI systems can generate their own forecasts that human superforecasters then evaluate and combine with their own judgments. For AI safety and epistemic security, improved forecasting offers several benefits. Better predictions about AI capabilities help with governance timing. Forecasting AI-related risks provides early warning. Publicly visible forecasts create accountability for claims about AI development. The key challenge is calibration - ensuring that probability estimates are meaningful across diverse domains and maintaining accuracy as AI systems become the subject of the forecasts themselves.

Details

Maturity

Rapidly emerging

Key Strength

Combines AI scale with human judgment

Key Challenge

Calibration across domains

Key Players

Metaculus, FutureSearch, Epoch AI

Related Pages

Top Related Pages

Risks

Automation Bias (AI Systems)AI-Induced Enfeeblement

Analysis

AI Forecasting Benchmark TournamentIrreversibility Threshold ModelAI Capability Threshold Model

Approaches

Prediction Markets (AI Forecasting)

Organizations

Epoch AIForecasting Research Institute (FRI)FutureSearchGood Judgment (Forecasting)MetaculusCenter for AI Safety

Concepts

Epistemic Tools Approaches OverviewAGI TimelineScientific Research Capabilities

Policy

Compute Thresholds

Key Debates

AI Risk Critical Uncertainties ModelAI Epistemic Cruxes

Other

Eli LiflandScalable Oversight

Sources

Tags

forecastingprediction-marketsai-capabilitiesdecision-makingcalibration