measurement error

Comparing Estimates of News Consumption from Survey and Passively Collected Behavioral Data

Surveys are a vital tool for understanding public opinion and knowledge, but they can also yield biased estimates of behavior. Here we explore a popular and important behavior that is frequently measured in public opinion surveys: news consumption. …

Data Quality in Data Science

Data scientists are increasingly turnig their attention to the collection of high quality training data. Those of us with expertise in data collection can apply lessons in web survey design to them.

Underreporting of Purchases in the U.S. Consumer Expenditure Survey

Motivated misreporting occurs when respondents give incorrect responses to survey questions to shorten the interview; studies have detected this behavior across many modes, topics, and countries. This paper tests whether motivated misreporting …

Panel Conditioning in the U.S. Consumer Expenditure Survey

The U.S. Consumer Expenditure Interview Survey asks many filter questions to identify the items that households purchase. Each reported purchase triggers follow-up questions about the amount spent and other details. We test the hypothesis that …

Understanding the Effects of Questionnaire Changes when Experiments are Not Possible: Application to the U.S. Consumer Expenditure Survey

Many large-scale government surveys do not have the budget or time to conduct experiments to assess the effects of questionnaire changes. Rather than conducting an experiment, this paper proposes the use of a parallel web survey and multiple …

Motivated Misreporting in the Consumer Expenditure Household Survey

Motivated misreporting occurs when respondents give incorrect responses to questions to shorten a survey interview. Previous research has shown that motivated misreporting occurs across many modes, topics and countries. Those studies have often …

Blending Survey and Passive Data

As survey costs increase and response rates decrease, researchers are looking to alternative methods to collect data from study subjects. Passive data are data collected from subjects without posing questions and recording responses. Examples are …

Motivated Misreporting in Smartphone Surveys

Filter questions are used to administer follow-up questions to eligible respondents while allowing respondents who are not eligible to skip those questions. Filter questions can be asked in either the interleafed or the grouped formats. In the …

Rotation Group Bias in Reporting of Household Purchases in the U.S. Consumer Expenditure Survey

We find rotation group bias in reports of spending in the U.S. Consumer Expenditure Survey. Contrary to our expectations, the more waves respondents complete, the higher the quality of their responses. Respondents become more likely to report the …

Misreporting Among Reluctant Respondents

Many surveys aim to achieve high response rates to keep bias due to nonresponse low. However, research has shown that the relationship between the nonresponse rate and nonresponse bias is small. In fact, high response rates may lead to measurement …