Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Shaefer and Edin's book ($2 a Day) cited in piece on political debate over plight of impoverished Americans

Eisenberg tracks factors affecting both mental health and athletic/academic performance among college athletes

Shapiro says Americans' low spending reflects "cruel lesson" about the dangers of debt

Highlights

Susan Murphy elected to the National Academy of Sciences

Maggie Levenstein named director of ISR's Inter-university Consortium for Political and Social Research

Arline Geronimus receives 2016 Harold R. Johnson Diversity Service Award

PSC spring 2016 newsletter: Kristin Seefeldt, Brady West, newly funded projects, ISR Runs for Bob, and more

Next Brown Bag

PSC Brown Bags
will resume fall 2016

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next