Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Lam looks at population and development in next 15 years in UN commission keynote address

Mitchell et al. find harsh family environments may magnify disadvantage via impact on 'genetic architecture'

Frey says Arizona's political paradoxes explained in part by demography

Highlights

PSC newsletter spring 2014 issue now available

Kusunoki wins faculty seed grant award from Institute for Research on Women and Gender

2014 PAA Annual Meeting, May 1-3, Boston

USN&WR ranks Michigan among best in nation for graduate education in sociology, public health, economics

Next Brown Bag

Monday, April 21
Grant Miller: Managerial Incentives in Public Service Delivery

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next