Test Scores AI vs Humans - Our World in Data

This source represents a critical compilation of AI benchmark data, systematically tracking the progression of artificial intelligence capabilities across multiple domains. By normalizing human performance as zero and initial AI performance at -100, the dataset offers a nuanced view of technological advancement in areas such as language understanding, image recognition, mathematical reasoning, and code generation. The research is significant for AI safety because it provides empirical evidence of AI systems' evolving capabilities, highlighting both remarkable progress and persistent limitations. Benchmarks like BBH, MMLU, and HumanEval demonstrate AI's growing sophistication in complex reasoning, knowledge application, and problem-solving. However, the varied performance across different domains also underscores the importance of comprehensive evaluation and the need for careful development of AI systems to ensure alignment with human values and capabilities.