Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Bailey and Dynarski cited in piece on why quality education should be a "civil and moral right"

Kalousova and Burgard find credit card debt increases likelihood of foregoing medical care

Bachman says findings on teens' greater materialism, slipping work ethic should be interpreted with caution

Highlights

Arline Geronimus wins Excellence in Research Award from School of Public Health

Yu Xie to give DBASSE's David Lecture April 30, 2013 on "Is American Science in Decline?"

U-M grad programs do well in latest USN&WR "Best" rankings

Sheldon Danziger named president of Russell Sage Foundation

Next Brown Bag



Back in September

Twitter Follow us 
on Twitter 

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next