Interviewer effects in food acquisition surveys

Publication Abstract

Ong, Ai Rene, Mengyao Hu, Brady T. West, and John A. Kirlin. 2018. "Interviewer effects in food acquisition surveys." Public health nutrition, 21(10): 1781-1793.

Objective

To understand the effects of interviewers on the responses they collect for measures of food security, income and selected survey quality measures (i.e. discrepancy between reported Supplemental Nutrition Assistance Program (SNAP) status and administrative data, length of time between initial and final interview, and missing income data) in the US Department of Agriculture's National Household Food Acquisition and Purchase Survey (FoodAPS).

Design

Using data from FoodAPS, multilevel models with random interviewer effects were fitted to estimate the variance in each outcome measure arising from effects of the interviewers. Covariates describing each household's socio-economic status, demographics and experience in taking the survey, and interviewer-level experience were included as fixed effects. The variance components in the outcomes due to interviewers were estimated. Outlier interviewers were profiled.

Setting

Non-institutionalized households in the continental USA (April 2012-January 2013).

Subjects

Individuals (n 14 317) in 4826 households who responded to FoodAPS.

Results

There was a substantial amount of variability in the distributions of the outcomes examined (i.e. time between initial and final interview, reported values for food security, individual income, missing income) among the FoodAPS interviewers, even after accounting for the fixed effects of the household- and interviewer-level covariates and removing extreme outlier interviewers.

Conclusions

Interviewers may introduce error in food acquisition survey data when they are asked to interact with the respondents. Managers of future surveys with similarly complex data collection procedures could consider using multilevel models to adaptively identify and retrain interviewers who have extreme effects on data collection outcomes.

10.1017/S1368980018000137

Keywords:
Methodology Food acquisition surveys FoodAPS Interviewer effects Survey methodology Multilevel modeling

Browse | Search | Next

PSC In The News

RSS Feed icon

Iglesias-Rios discusses dangers of COVID-19 outbreaks among Michigan farm workers

Stern comments on US history of forced sterilization in light of allegations about conditions in ICE custody

Schulenberg finds marijuana use at four decade high among young adults

More News

Highlights

Help Establish Standard Data Collection Protocols for COVID-19 Research

Prescott wins Distinguished University Innovator Award for foundation of Matterhorn online legal tool

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook