Stanford University — Language Model Evaluations

[Navigating Transformative AI] Open Philanthropy recommended a grant of $250,000 to Stanford University to support Holistic Evaluation of Language Models (HELM), which is a project to evaluate language models using many different tests designed to assess their capabilities, safety, and fairness. This work is led by Professor Percy Liang, and this funding will support an additional engineer for HELM. This follows our November 2021 support and falls within our focus area of potential risks from advanced artificial intelligence.