Skip to content
Longterm Wiki

Introducing the ML Safety Scholars Program

web

Authors

TW123·Dan H·Mantas Mazeika·Oliver Z·Sidney Hough·Kevin Liu

Credibility Rating

3/5
Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: EA Forum

This EA Forum post announces a fellowship/scholars program aimed at expanding the pool of researchers working on technical ML safety, relevant to those interested in career pathways or talent development in AI safety.

Metadata

Importance: 45/100news

Summary

This post announces the ML Safety Scholars Program, an initiative designed to introduce talented students and early-career researchers to machine learning safety research. The program aims to build the pipeline of researchers working on technical AI safety by providing structured learning, mentorship, and community.

Key Points

  • Launches a structured program to train and onboard new researchers into the ML safety field
  • Targets students and early-career individuals interested in technical AI safety work
  • Provides mentorship, resources, and community to accelerate participants' entry into safety research
  • Part of broader efforts to grow the AI safety research talent pipeline
  • Reflects the EA community's focus on capacity-building for existential risk mitigation

Cached Content Preview

HTTP 200Fetched Apr 9, 20266 KB
# Introducing the ML Safety Scholars Program
By TW123, Dan H, Mantas Mazeika, Oliver Z, Sidney Hough, Kevin Liu
Published: 2022-05-04
Program Overview
----------------

The Machine Learning Safety Scholars program is a paid, 9-week summer program designed to help undergraduate students gain skills in machine learning with the aim of using those skills for empirical AI safety research in the future. Apply for the program [here](https://airtable.com/shrNYFhCRTjY54FIO) by May 31st.

The course will have three main parts:

*   **Machine learning**, with lectures and assignments from MIT
*   **Deep learning**, with lectures and assignments from the University of Michigan, NYU, and Hugging Face
*   **ML safety**, with lectures and assignments produced by [Dan Hendrycks](https://danhendrycks.com/) at UC Berkeley

The first two sections are based on public materials, and we plan to make the ML safety course publicly available soon as well. The purpose of this program is not to provide proprietary lessons but to better facilitate learning:

*   The program will have a Slack, regular office hours, and active support available for all Scholars. We hope that this will provide useful feedback over and above what’s possible with self-studying.
*   The program will have designated “work hours” where students will cowork and meet each other. We hope this will provide motivation and accountability, which can be hard to get while self-studying.
*   We will pay Scholars a $4,500 stipend upon completion of the program. This is comparable to undergraduate research roles and will hopefully provide more people with the opportunity to study ML.

MLSS will be fully remote, so participants will be able to do it from wherever they’re located. 

Why have this program?
----------------------

Much of AI safety research currently focuses on existing machine learning systems, so it’s necessary to understand the fundamentals of machine learning to be able to make contributions. While many students learn these fundamentals in their university courses, some might be interested in learning them on their own, perhaps because they have time over the summer or their university courses are badly timed. In addition, we don’t think that any university currently devotes multiple weeks to AI Safety.

There are already sources of funding for upskilling within EA, such as the [Long Term Future Fund](https://funds.effectivealtruism.org/funds/far-future). Our program focuses specifically on ML and therefore we are able to provide a curriculum and support to Scholars in addition to funding, so they can focus on learning the content.

Our hope is that this program can contribute to producing knowledgeable and motivated undergraduates who can then use their skills to contribute to the most pressing research problems within AI safety.

Time Commitment
---------------

The program will last 9 weeks, beginning on Monday, June 20th, and ending on August 19th. We expect each week of the program to co

... (truncated, 6 KB total)
Resource ID: 65d92d482b71030d | Stable ID: sid_r6zWnf7ZpQ