A Typology of Web Survey Paradata for Assessing Total Survey Error

Publication Abstract

McClain, Colleen A., Mick P. Couper, Andrew Hupp, Florian Keusch, Gregg Peterson, Andrew Piskorowski, and Brady T. West. 2019. "A Typology of Web Survey Paradata for Assessing Total Survey Error." Social Science Computer Review, 37(2): 196-213.

This article reviews the existing literature on the collection of paradata in web surveys and extends the research in this area beyond the commonly studied measurement error problem to paradata that can be collected for managing and mitigating other important sources of error. To do so, and in keeping with the nature of paradata as process-oriented, we develop a typology of web survey paradata that incorporates information from all steps in the web survey process. We first define web survey paradata and describe general phases of paradata that run parallel to the steps in fielding a typical web survey. Within each phase, we enumerate several errors within the total survey error paradigm that can be examined with paradata, discussing case studies and motivating examples that illustrate innovative uses of paradata across the web survey process. We conclude with a discussion of open questions and opportunities for further work in this area. Overall, we develop this typology keeping technological advancements at the center of our discussion, but with flexibility to continuously incorporate new developments and trends in both technology and study design. Our typology encourages researchers to think about paradata as tools that can be used to investigate a broader range of outcomes than previously studied.; This article reviews the existing literature on the collection of paradata in web surveys and extends the research in this area beyond the commonly studied measurement error problem to paradata that can be collected for managing and mitigating other important sources of error. To do so, and in keeping with the nature of paradata as process-oriented, we develop a typology of web survey paradata that incorporates information from all steps in the web survey process. We first define web survey paradata and describe general phases of paradata that run parallel to the steps in fielding a typical web survey. Within each phase, we enumerate several errors within the total survey error paradigm that can be examined with paradata, discussing case studies and motivating examples that illustrate innovative uses of paradata across the web survey process. We conclude with a discussion of open questions and opportunities for further work in this area. Overall, we develop this typology keeping technological advancements at the center of our discussion, but with flexibility to continuously incorporate new developments and trends in both technology and study design. Our typology encourages researchers to think about paradata as tools that can be used to investigate a broader range of outcomes than previously studied.

10.1177/0894439318759670

Keywords:
Methodology

Browse | Search | Next

PSC In The News

RSS Feed icon

Iglesias-Rios discusses dangers of COVID-19 outbreaks among Michigan farm workers

Stern comments on US history of forced sterilization in light of allegations about conditions in ICE custody

Schulenberg finds marijuana use at four decade high among young adults

More News

Highlights

Help Establish Standard Data Collection Protocols for COVID-19 Research

Prescott wins Distinguished University Innovator Award for foundation of Matterhorn online legal tool

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook