Informing sequential clinical decision-making through reinforcement learning: an empirical study

Publication Abstract

Shortreed, Susan M., Eric Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau , and Susan A. Murphy. 2011. "Informing sequential clinical decision-making through reinforcement learning: an empirical study." Machine Learning, 84(1-2): 109-136.

This paper highlights the role that reinforcement learning can play in the optimization of treatment policies for chronic illnesses. Before applying any off-the-shelf reinforcement learning methods in this setting, we must first tackle a number of challenges. We outline some of these challenges and present methods for overcoming them. First, we describe a multiple imputation approach to overcome the problem of missing data. Second, we discuss the use of function approximation in the context of a highly variable observation set. Finally, we discuss approaches to summarizing the evidence in the data for recommending a particular action and quantifying the uncertainty around the Q-function of the recommended policy. We present the results of applying these methods to real clinical trial data of patients with schizophrenia.

10.1007/s10994-010-5229-0

PMCID: PMC3143507. (Pub Med Central)

Country of focus: United States of America.

Wellbeing of Older Persons in Southeast Asia (Bibliography)

Browse | Search | Books | Next

PSC In The News

RSS Feed icon

Miller comments on local efforts to provide healthcare to vulnerable populations

Shaefer discusses Americans with tight financial resources have fewer options as they navigate coronavirus closures and layoffs in NYT

Shaefer: Michigan strains unemployment system with most claims since Great Recession

More News

Highlights

Data Scientist Job Open at PSC/PDHP

New Investigator Mentoring Program (PDHP) Applications Sought

More Highlights


Connect with PSC follow PSC on Twitter Like PSC on Facebook