Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Krause says having religious friends leads to gratitude, which is associated with better health

Work by Bailey and Dynarski on growing income gap in graduation rates cited in NYT

Johnston says marijuana use by college students highest in 30 years

Highlights

Martha Bailey and Nicolas Duquette win Cole Prize for article on War on Poverty

Michigan's graduate sociology program tied for 4th with Stanford in USN&WR rankings

Jeff Morenoff makes Reuters' Highly Cited Researchers list for 2014

Susan Murphy named Distinguished University Professor

Next Brown Bag

Monday, Sep 22
Paula Fomby (Michigan), Family Complexity, Siblings, and Children's Aggressive Behavior at School Entry

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next