Interviewer effects in food acquisition surveys

Publication Abstract

Ong, Ai Rene, Mengyao Hu, Brady T. West, and John A. Kirlin. 2018. "Interviewer effects in food acquisition surveys." Public health nutrition, 21(10): 1781-1793.

Objective

To understand the effects of interviewers on the responses they collect for measures of food security, income and selected survey quality measures (i.e. discrepancy between reported Supplemental Nutrition Assistance Program (SNAP) status and administrative data, length of time between initial and final interview, and missing income data) in the US Department of Agriculture's National Household Food Acquisition and Purchase Survey (FoodAPS).

Design

Using data from FoodAPS, multilevel models with random interviewer effects were fitted to estimate the variance in each outcome measure arising from effects of the interviewers. Covariates describing each household's socio-economic status, demographics and experience in taking the survey, and interviewer-level experience were included as fixed effects. The variance components in the outcomes due to interviewers were estimated. Outlier interviewers were profiled.

Setting

Non-institutionalized households in the continental USA (April 2012-January 2013).

Subjects

Individuals (n 14 317) in 4826 households who responded to FoodAPS.

Results

There was a substantial amount of variability in the distributions of the outcomes examined (i.e. time between initial and final interview, reported values for food security, individual income, missing income) among the FoodAPS interviewers, even after accounting for the fixed effects of the household- and interviewer-level covariates and removing extreme outlier interviewers.

Conclusions

Interviewers may introduce error in food acquisition survey data when they are asked to interact with the respondents. Managers of future surveys with similarly complex data collection procedures could consider using multilevel models to adaptively identify and retrain interviewers who have extreme effects on data collection outcomes.

10.1017/S1368980018000137

Keywords:
Methodology Food acquisition surveys FoodAPS Interviewer effects Survey methodology Multilevel modeling

Browse | Search | Next

PSC In The News

RSS Feed icon

Harvard Magazine looks at Inglehart and Norris' book - Cultural Backlash: Trump, Brexit, & Authoritarian Populism

Courant on The Real Problem With Grade Inflation

Study by Miller et al. shows that doctors prescribe more branded medications after marketing visits by the makers of those drugs.

More News

Highlights

Data Scientist Job Open at PSC/PDHP

New Investigator Mentoring Program (PDHP) Applications Sought

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook