Nonparametric segmentation methods: Applications of unsupervised machine learning and revealed preference

• Published in: American journal of agricultural economics Vol. 104; no. 3; pp. 976 - 998
• Main Authors: Blumberg, Joey, Thompson, Gary
• Format: Journal Article
• Language: English
• Published: Boston, USA Wiley Periodicals, Inc 01-05-2022; Blackwell Publishing Ltd
• Subjects: Agricultural economics; Algorithms; Consumers; Demographic variables; Economic incentives; Expenditures; fruit and vegetable consumption; Fruits; Healthy food; Heterogeneity; Households; Incentives; Learning algorithms; Machine learning; Nonparametric statistics; Price elasticity; Responsiveness; revealed preferences; Segmentation; Segments; Unsupervised learning; unsupervised machine learning; Vegetables; United States > US
• ISSN: 0002-9092; 1467-8276
• DOI: 10.1111/ajae.12257

Many recent efforts by econometricians have focused on supervised machine learning techniques to aid in empirical studies using experimental data. By contrast, this article explores the merits of unsupervised machine learning algorithms for informing ex ante policy design using observational data. We examine the extent to which groups of consumers with differing responses to economic incentives can be identified in a context of fruit and vegetable demand. Two classes of nonparametric algorithms—revealed preference and unsupervised machine learning—are compared for segmenting households in the National Consumer Panel. Nonlinear almost‐ideal demand models are estimated for all segments to determine which methods group households into segments with different expenditure and price elasticities. In‐sample comparisons and out‐of‐sample prediction results indicate methods using price‐quantity data alone—without demographic, geographic, or other variables—perform better at segmenting households into groups with sizeable differences in price and expenditure responsiveness. These segmentation results suggest considerable heterogeneity in household purchasing behavior of fruits and vegetables.