Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Almirall says comparing SMART designs will increase treatment quality for children with autism

Thompson says America must "unchoose" policies that have led to mass incarceration

Alter says lack of access to administrative data is "big drag on research"


Susan Murphy to speak at U-M kickoff for data science initiative, Oct 6, Rackham

Andrew Goodman-Bacon, former trainee, wins 2015 Nevins Prize for best dissertation in economic history

Deirdre Bloome wins ASA award for work on racial inequality and intergenerational transmission

Bob Willis awarded 2015 Jacob Mincer Award for Lifetime Contributions to the Field of Labor Economics

Next Brown Bag

Monday, Oct 12 at noon, 6050 ISR
Joe Grengs: Policy & planning for transportation equity

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next