Home > Publications . Search All . Browse All . Country . Browse PSC Pubs . PSC Report Series

PSC In The News

RSS Feed icon

Elliott co-PI on new study examining how early environment impacts children's health

Levy says ACA has helped increase rates of insured, but rates still lowest among poor

Bruch reveals key decision criteria in making first cuts on dating sites

More News

Highlights

U-M ranked #4 in USN&WR's top public universities

Frey's new report explores how the changing US electorate could shape the next 5 presidential elections, 2016 to 2032

U-M's Data Science Initiative offers expanded consulting services via CSCAR

Elizabeth Bruch promoted to Associate Professor

Next Brown Bag

Mon, Oct 3 at noon:
Longevity, Education, & Income, Hoyt Bleakley

Susan A. Murphy photo

A generalization error for Q-learning

Publication Abstract

Murphy, Susan A. 2005. "A generalization error for Q-learning." Journal of Machine Learning Research, 6(July): 1073-1097.

Planning problems that involve learning a policy from a single training set of finite horizon trajectories arise in both social science and medical fields. We consider Q-learning with function approximation for this setting and derive an upper bound on the generalization error. This upper bound is in terms of quantities minimized by a Q-learning algorithm, the complexity of the approximation space and an approximation term due to the mismatch between Q-learning and the goal of learning a policy that maximizes the value function.

PMCID: PMC1475741. (Pub Med Central)

Browse | Search : All Pubs | Next