Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Prescott says sex offender registries may increase recidivism by making offender re-assimilation impossible

Frey says rising numbers of younger minority voters mean Republicans must focus on fiscal not social issues

Work by Garces and Mickey-Pabello cited in NYT piece on lack of black physicians

Highlights

Elizabeth Bruch wins Robert Merton Prize for paper in analytic sociology

Elizabeth Bruch wins ASA award for paper in mathematical sociology

Spring 2015 PSC newletter available now

Formal demography workshop and conference at UC Berkeley, August 17-21

Next Brown Bag

PSC Brown Bags will be back fall 2015


Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next