Epoch AI

Epoch AI provides comprehensive insights into the trajectory of AI development, focusing on quantitative metrics like training compute, model scaling, and hardware performance. Their research highlights exponential growth in computational resources dedicated to AI model training, with notable trends such as training compute doubling approximately every six months since 2010. Their methodology involves collecting and analyzing data from published AI models across domains like language, vision, and games, tracking metrics such as floating-point operations (FLOP), training costs, and computational performance. While their approach provides valuable empirical insights, limitations include potential selection bias in model reporting and the challenge of comprehensively capturing global AI development.