AEA Papers and Proceedings
ISSN 2574-0768 (Print) | ISSN 2574-0776 (Online)
Measuring Racial Discrimination in Algorithms
AEA Papers and Proceedings
vol. 111,
May 2021
(pp. 49–54)
Abstract
Algorithmic decision-making can lead to discrimination against legally protected groups, but measuring such discrimination is often hampered by a fundamental selection challenge. We develop new quasi-experimental tools to overcome this challenge and measure algorithmic discrimination in pretrial bail decisions. We show that the selection challenge reduces to the challenge of measuring four moments, which can be estimated by extrapolating quasi-experimental variation across as-good-as-randomly assigned decision-makers. Estimates from New York City show that both a sophisticated machine learning algorithm and a simpler regression model discriminate against Black defendants even though defendant race and ethnicity are not included in the training data.Citation
Arnold, David, Will Dobbie, and Peter Hull. 2021. "Measuring Racial Discrimination in Algorithms." AEA Papers and Proceedings, 111: 49–54. DOI: 10.1257/pandp.20211080Additional Materials
JEL Classification
- J15 Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination
- K40 Legal Procedure, the Legal System, and Illegal Behavior: General