Informing sequential clinical decision-making through reinforcement learning: an empirical study

Archived Abstract of Former PSC Researcher

Shortreed, Susan M., Eric Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau , and Susan A. Murphy. 2011. "Informing sequential clinical decision-making through reinforcement learning: an empirical study." Machine Learning, 84(1-2): 109-136.

This paper highlights the role that reinforcement learning can play in the optimization of treatment policies for chronic illnesses. Before applying any off-the-shelf reinforcement learning methods in this setting, we must first tackle a number of challenges. We outline some of these challenges and present methods for overcoming them. First, we describe a multiple imputation approach to overcome the problem of missing data. Second, we discuss the use of function approximation in the context of a highly variable observation set. Finally, we discuss approaches to summarizing the evidence in the data for recommending a particular action and quantifying the uncertainty around the Q-function of the recommended policy. We present the results of applying these methods to real clinical trial data of patients with schizophrenia.

10.1007/s10994-010-5229-0

PMCID: PMC3143507. (Pub Med Central)

Country of focus: United States of America.

Browse | Search | Books

PSC In The News

RSS Feed icon

Erin Cech explains her research on the "passion principle," and how America's obsession with pursuing and pushing towards a "#dreamjob" is flawed

Shaefer notes success of initial CARES Act stimulus and concerns over a new round of COVID-19 shutdown support under a Biden presidency

More News

Highlights

Faul's three-nation research to examine relationships between social factors and epigenetics

Open for Registration: Principles of Text Analysis Workshop

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook