A Practical Solution to the Reference Class Problem

Authors

Edward K. Cheng

Document Type

Article

Publication Title

Columbia Law Review

Publication Date

2009

ISSN

0010-1958

Page Number

2081

Keywords

statistical method, judicial statistics, model selection theory, reference class, statistical evidence

Disciplines

Evidence | Law | Management Sciences and Quantitative Methods | Statistical Models

Abstract

The "reference class problem" is a serious challenge to the use of statistical evidence that arguably arises every day in wide variety of cases, including toxic torts, property valuation, and even drug smuggling. At its core, it observes that statistical inferences depend critically on how people, events, or things are classified. As there is (purportedly) no principle for privileging certain categories over others, statistics become manipulable, undermining the very objectivity and certainty that make statistical evidence valuable and attractive to legal actors. In this paper, I propose a practical solution to the reference class problem by drawing on model selection theory in statistics. The solution has potentially wide-ranging and significant implications for statistics in the law. Not only does it remove another barrier to the use of statistics in legal decisionmaking, but it also suggests a concrete framework by which litigants can present, evaluate, and contest statistical evidence.

Recommended Citation

Edward K. Cheng, A Practical Solution to the Reference Class Problem, 109 Columbia Law Review. 2081 (2009)
Available at: https://scholarship.law.vanderbilt.edu/faculty-publications/154