Cambridge in America — Data Science Benchmark

[Navigating Transformative AI] Open Philanthropy recommended a gift of $517,693 over two years to Cambridge in America to support the development of a benchmark for evaluating the performance of Large Language Model (LLM) agents in data science tasks. The project will be led by Professors Lorenzo Pacchiardi, José Hernández-Orallo, and Lucy Cheke. This gift was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within our focus area of potential risks from advanced artificial intelligence.