TitleBeating the defense: Using plan recognition to inform learning agents
Publication TypeConference Paper
Year of Publication2009
AuthorsMolineaux, M, Aha, DW, Sukthankar, G
Conference NameInternational FLAIRS Conference
PublisherAAAI Press
Conference LocationSanibel Island, FL
Keywordscase-based reinforcement learning, game AI, plan recognition
Abstract

In this paper, we investigate the hypothesis that plan recognition can significantly improve the performance of a casebased reinforcement learner in an adversarial action selection task. Our environment is a simplification of an American football game. The performance task is to control the behavior of a quarterback in a pass play, where the goal is to maximize yardage gained. Plan recognition focuses on predicting the play of the defensive team. We modeled plan recognition as an unsupervised learning task, and conducted a lesion study. We found that plan recognition was accurate, and that it significantly improved performance. More generally, our studies show that plan recognition reduced the dimensionality of the state space, which allowed learning to be conducted more effectively. We describe the algorithms, explain the reasons for performance improvement, and also describe a further empirical comparison that highlights the utility of plan recognition for this task.

Refereed DesignationRefereed
Full Text
pdf: 
http://www.nrl.navy.mil/itd/aic/sites/www.nrl.navy.mil.itd.aic/files/pdfs/Beating%20the%20Defense%20%28Molineaux%20et%20al.%2C%20FLAIRS-09%29.pdf
NRL Publication Release Number: 
08-1226-4010
pub_tags: 
plan recognition
game AI
case-based reinforcement learning
key_pub_tags: