Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Xu et al find lower cognition at midlife for adults born during China's 1959-61 famine

UM's Wolfers on separating deep expertise from partisanship in analyses of economic condtions

Findings by Burgard, Kalousova, and Seefeldt on the mental health impact of job insecurity

More News


Apply by Jan 8 for NIA-supported PSC post-doc fellowship, to begin Sept 1, 2018

On Giving Blue Day, help support the next generation through the PSC Alumni Grad Student Support Fund or ISR's Next Gen Fund

Bailey et al. find higher income among children whose parents had access to federal family planning programs in the 1960s and 70s

U-M's campus climate survey results discussed in CHE story

More Highlights

Next Brown Bag

Mon, Jan 22, 2018, noon: Narayan Sastry

Brady T. West photo

The PAIP Score: A Propensity-Adjusted Interviewer Performance Indicator

Publication Abstract

West, Brady T., and Robert M. Groves. 2011. "The PAIP Score: A Propensity-Adjusted Interviewer Performance Indicator." Joint Statistical Meetings Proceedings, Social Statistics,

Evaluating interviewers based on their response rates is complicated in most surveys. By random chance, interviewers may call cases that are more or less difficult to interview. In addition, interviewer response rates can only imperfectly be computed because of the contributions of other interviewers' prior contacts with those cases (calling a case after a contact from an expert interviewer may pose different difficulties than calling a case after a contact from an inexperienced interviewer). This paper proposes and evaluates an interviewer performance indicator that attempts to repair these weaknesses. The proposed indicator is computed using a three-step algorithm. First, for each active case, available paradata are used to estimate the propensity that the next contact with the case will generate an interview. Second, if the interviewer assigned the case obtains a successful interview on the next contact, the interviewer receives a score of 1 minus the estimated response propensity for the contact; a non-successful contact by the interviewer results in a score of 0 minus the estimated response propensity for the contact. Finally, for each interviewer, the contact-level scores are averaged over all contacts, resulting in a propensity-adjusted interviewer performance (PAIP) score. Addressing an important drawback of previous interviewer performance measures discussed in the literature, this performance indicator gives large credit to the interviewer who obtains success on very difficult cases, and only a small penalty given failure with such cases. The indicator gives only small credit to success on very easy cases and larger penalties given failure with easy cases. This paper illustrates computation of the PAIP score using two different surveys (one face-to-face, one telephone), and assesses the validity of the indicator as a new metric for evaluating the performance of interviewers.

Public Access Link

Country of focus: United States of America.

Browse | Search : All Pubs | Next