How Racial Bias Infected a Major Health-Care Algorithm

web

chicagobooth.edu·chicagobooth.edu/review/how-racial-bias-infected-major-he...

A prominent real-world case study of algorithmic bias in high-stakes AI deployment, frequently cited in discussions of fairness, proxy variables, and the societal risks of poorly audited automated decision systems in healthcare.

Metadata

Importance: 68/100news articleanalysis

Summary

This article examines a widely-used health care algorithm that systematically underestimated the medical needs of Black patients compared to white patients with the same health conditions, directing fewer resources to Black patients. The bias stemmed from using health care costs as a proxy for health needs, which reflected historical disparities in access to care rather than actual illness severity. The case illustrates how seemingly neutral algorithmic design choices can encode and amplify systemic racial inequities.

Key Points

•A major health algorithm used by insurers and hospitals assigned Black patients lower 'risk scores' than equally sick white patients, reducing their access to care management programs.
•The bias originated from using historical healthcare spending as a proxy for health need—spending that was lower for Black patients due to systemic barriers to care access, not better health.
•The algorithm affected an estimated 200 million people in the U.S., demonstrating the scale at which biased AI systems can cause harm when deployed in critical sectors.
•The case shows that algorithmic bias can be unintentional and arise from flawed proxy variables, making pre-deployment auditing and outcome monitoring essential.
•Switching the target variable from costs to health outcomes could reduce the measured racial disparity by more than 80%, highlighting how design choices directly shape equity outcomes.

Cited by 1 page

Page	Type	Quality
AI-Driven Institutional Decision Capture	Risk	73.0

Cached Content Preview

HTTP 200Fetched Apr 9, 202610 KB

How Racial Bias Infected a Major Health-Care Algorithm | Chicago Booth Review

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 

 

 
 

 

 
 
 
 

 Nov
 DEC
 Jan
 

 
 

 
 16
 
 

 
 

 2024
 2025
 2026
 

 
 
 

 

 

 
 
success

 
fail

 
 
 
 
 
 
 
 
 
 
 

 

 
 
 
 
 
 
 
 
 

 

 About this capture
 

 

 

 

 

 

 
COLLECTED BY

 

 

 
 
Collection: Common Crawl

 

 

 Web crawl data from Common Crawl.
 

 

 

 

 

 
TIMESTAMPS

 

 

 

 

 

 

The Wayback Machine - http://web.archive.org/web/20251216204411/https://www.chicagobooth.edu/review/how-racial-bias-infected-major-health-care-algorithm

 
 
 
 
 
 
 
 
 
 

 

 

 

 

 

 
 This website uses cookies to ensure the best user experience.

 Privacy & Cookies Notice
 
 
 
 Accept Cookies
 
 
 Reject Cookies
 
 
 
 Manage My Cookies
 
 
 
 

 

 

 

 
 

 

 

 

 Close
 
Manage Cookie Preferences

 Accept All Cookies
 Reject All Cookies
 

 

 
 

 
 NECESSARY COOKIES

 These cookies are essential to enable the services to provide the requested feature, such as remembering you have logged in.
 
 ALWAYS ACTIVE
 

 

 
 
 Reject | Accept
 
 

 

 
 PERFORMANCE AND ANALYTIC COOKIES

 These cookies are used to collect information on how users interact with Chicago Booth websites allowing us to improve the user experience and optimize our site where needed based on these interactions. All information these cookies collect is aggregated and therefore anonymous.
 
 
 

 
 
 
 
 

 
 

 

 
 FUNCTIONAL COOKIES

 These cookies enable the website to provide enhanced functionality and personalization. They may be set by third-party providers whose services we have added to our pages or by us.
 
 
 

 
 
 
 
 

 
 

 

 
 TARGETING OR ADVERTISING COOKIES

 These cookies collect information about your browsing habits to make advertising relevant to you and your interests. The cookies will remember the website you have visited, and this information is shared with other parties such as advertising technology service providers and advertisers.
 
 
 

 
 
 
 
 

 
 

 

 
 SOCIAL MEDIA COOKIES

 These cookies are used when you share information using a social media sharing button or “like” button on our websites, or you link your account or engage with our content on or through a social media site. The social network will record that you have done this. This information may be linked to targeting/advertising activities.
 
 
 

 
 
 
 
 

 
 

 

 

 

 

 Confirm My Selections
 

 

 

 

 

 

 

 

 

 

 

 

 
 
 
 

 

 
 

 

Skip to main content

 

 
 

 The University of Chicago Booth School of Business
 

 
 
 
 

 Monetary Policy
 

 

 Inequality
 

 

 Health Care
 

 

 Climate Change
 

 

 Artificial Intelligence
 

 

 Motivation
 

 

 Jobs
 

 
 
 
 
 
+All CBR Topics

 

 
 
 
 
 

 
 
 
 

 

 

 Home-->

 

Chicago Booth Review
 
 
Monetary Policy

 
Inequality

 
Health Care

 
Climate Change

 
Artificial Intelligence

 
Motivation

 
Jobs

 
All Chicago Booth Review Topics

 

 



... (truncated, 10 KB total)

Resource ID: dd87aea8332e4cfa | Stable ID: sid_SnS3y4T8rP