The right tool for the job: choosing between covariate balancing and generalized boosted model propensity scores

Archived Abstract of Former PSC Researcher

Setodji, Claude M., Daniel F. McCaffrey, Lane F. Burgette, Daniel Almirall, and Beth Ann Griffin. 2017. "The right tool for the job: choosing between covariate balancing and generalized boosted model propensity scores." Epidemiology, 28(6): 802-811.

Estimating the causal effect of an exposure (versus some control) on an outcome using observational data often requires addressing the fact that exposed and control groups differ on pre-exposure characteristics that may be related to the outcome (confounders). Propensity score methods have long been used as a tool for adjusting for observed confounders in order to produce more valid causal effect estimates under the strong ignorability assumption. In this article, we compare two promising propensity score estimation methods (for time invariant binary exposures) when assessing the average treatment effect on the treated: the generalized boosted models and covariate-balancing propensity scores, with the main objective to provide analysts with some rules-of-thumb when choosing between these two methods. We compare the methods across different dimensions including the presence of extraneous variables, the complexity of the relationship between exposure or outcome and covariates, and the residual variance in outcome and exposure. We found that when non-complex relationships exist between outcome or exposure and covariates, the covariate-balancing method outperformed the boosted method, but under complex relationships, the boosted method performed better. We lay out criteria for when one method should be expected to outperform the other with no blanket statement on whether one method is always better than the other. Copyright (C) 2017 Wolters Kluwer Health, Inc. All rights reserved.

10.1097/EDE.0000000000000734

Keywords:
Methodology Causal inference observational study propensity score variable selection diagnostic tools

Browse | Search | Next

PSC In The News

RSS Feed icon

Shaefer comments on the Cares Act impact in negating hardship during COVID-19 pandemic

Heller comments on lasting safety benefit of youth employment programs

More News

Highlights

Dean Yang's Combatting COVID-19 in Mozambique study releases Round 1 summary report

Help Establish Standard Data Collection Protocols for COVID-19 Research

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook