Exhaustive or exhausting? Evidence on respondent fatigue in long surveys

• Published in: Journal of development economics Vol. 161; p. 102992
• Main Authors: Jeong, Dahyeon, Aggarwal, Shilpa, Robinson, Jonathan, Kumar, Naresh, Spearot, Alan, Park, David Sungho
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01-03-2023
• Subjects: Design of experiments; Measurement; Survey fatigue; Survey methodology; Measurement; O12; Survey methodology; C93; Survey fatigue; Design of experiments; C83
• ISSN: 0304-3878; 1872-6089
• DOI: 10.1016/j.jdeveco.2022.102992

Living standards measurement surveys require sustained attention for several hours. We quantify survey fatigue by randomizing the order of questions in 2–3 hour-long in-person surveys. An additional hour of survey time increases the probability that a respondent skips a question by 10%–64%. Because skips are more common, the total monetary value of aggregated categories such as assets or expenditures declines as the survey goes on, and this effect is sizeable for some categories: for example, an extra hour of survey time lowers food expenditures by 25%. We find similar effect sizes within phone surveys in which respondents were already familiar with questions, suggesting that cognitive burden may be a key driver of survey fatigue.
•We study the effect of survey fatigue on response quality in long surveys.•Identification is based on randomized placement of questions in surveys.•An extra hour of surveying increases the probability of a respondent skipping a question by 10%–64%•Reported monetary values of items also decline.•Effects are similar for phone surveys, which were much shorter in duration and were already familiar to respondents.