incentives

Data Quality in Data Science

Data scientists are increasingly turnig their attention to the collection of high quality training data. Those of us with expertise in data collection can apply lessons in web survey design to them.

Underreporting of Purchases in the U.S. Consumer Expenditure Survey

Motivated misreporting occurs when respondents give incorrect responses to survey questions to shorten the interview; studies have detected this behavior across many modes, topics, and countries. This paper tests whether motivated misreporting …

Panel Conditioning in the U.S. Consumer Expenditure Survey

The U.S. Consumer Expenditure Interview Survey asks many filter questions to identify the items that households purchase. Each reported purchase triggers follow-up questions about the amount spent and other details. We test the hypothesis that …

Understanding the Effects of Questionnaire Changes when Experiments are Not Possible: Application to the U.S. Consumer Expenditure Survey

Many large-scale government surveys do not have the budget or time to conduct experiments to assess the effects of questionnaire changes. Rather than conducting an experiment, this paper proposes the use of a parallel web survey and multiple …

Motivated Misreporting in the Consumer Expenditure Household Survey

Motivated misreporting occurs when respondents give incorrect responses to questions to shorten a survey interview. Previous research has shown that motivated misreporting occurs across many modes, topics and countries. Those studies have often …

Motivated Misreporting in Smartphone Surveys

Filter questions are used to administer follow-up questions to eligible respondents while allowing respondents who are not eligible to skip those questions. Filter questions can be asked in either the interleafed or the grouped formats. In the …

Rotation Group Bias in Reporting of Household Purchases in the U.S. Consumer Expenditure Survey

We find rotation group bias in reports of spending in the U.S. Consumer Expenditure Survey. Contrary to our expectations, the more waves respondents complete, the higher the quality of their responses. Respondents become more likely to report the …

Interviewer Invovlement in Sample Selection Shapes the Relationship between Response Rates and Data Quality

Several studies have shown that high response rates are not associated with low bias in survey data. This paper shows that, for face-to-face surveys, the relationship between response rates and bias is moderated by the type of sampling method used. …

Misreporting Among Reluctant Respondents

Many surveys aim to achieve high response rates to keep bias due to nonresponse low. However, research has shown that the relationship between the nonresponse rate and nonresponse bias is small. In fact, high response rates may lead to measurement …

Misreporting to Looping Questions in Surveys: Recall, Motivation and Burden

Looping questions are used to collect data about several similar events, such as employment spells, retirement accounts, or marriages. The loops gather information about the number of events experienced as well as details about each one. The …