Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Stafford says too early to say whether stock market declines will curtail Americans' spending

Eisenberg says many colleges now train campus personnel to spot and refer troubled college students

Farley on new strategies for city insolvencies in Michigan

Highlights

Call for papers: Conference on Integrating Genetics and the Social Sciences, Oct 21-22, 2016, CU-Boulder

PRB training program in policy communication for pre-docs. Application deadline, 2.28.2016

Call for proposals: PSID small grants for research on life course impacts on later life wellbeing

PSC News, fall 2015 now available

Next Brown Bag

Monday, Feb 1 at noon, 6050 ISR-Thompson
Sarah Miller

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next