Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Bailey and Danziger's War on Poverty book reviewed in NY Review of Books

Bloomberg cites MTF data in story on CDC's anti-smoking ads for e-cigarettes

Bound says notion that foreign college students are displacing U.S. students "isn't right"

Highlights

U-M ranked #1 in Sociology of Population by USN&WR's "Best Graduate Schools"

PAA 2015 Annual Meeting: Preliminary program and list of UM participants

ISR addition wins LEED Gold Certification

PSC Fall 2014 Newsletter now available

Next Brown Bag

Mon, April 6
Jinkook Lee, Wellbeing of the Elderly in East Asia

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next