Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Thompson says public trust in prison system is unwarranted

Study by former PSC trainee Hershbein cited in NR argument that teen contraceptive programs don't work

Stafford explores differences in intergenerational job mobility for today's working men and women

More News

Highlights

MiCDA Research Fellowship - applications due July 21, 2017

U-M awarded $58 million to develop ideas for preventing and treating health problems

Bailey, Eisenberg , and Fomby promoted at PSC

Former PSC trainee Eric Chyn wins PAA's Dorothy S. Thomas Award for best paper

More Highlights

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next