Making Friends on the Fly: Advances in Ad Hoc Teamwork

This book is devoted to the encounter and interaction of agents such as robots with other agents and describes how they cooperate with their previously unknown teammates, forming an Ad Hoc team. It presents a new algorithm, PLASTIC, that allows agents to quickly adapt to new teammates by reusing knowledge learned from previous teammates. PLASTIC is instantiated in both a model-based approach, PLASTIC-Model and a policy-based approach, PLASTIC-Policy. In addition to reusing knowledge learned from previous teammates, PLASTIC also allows users to provide expert-knowledge and can use transfer learning (such as the new Two Stage Transfer algorithm) to quickly create models of new teammates when it has some information about its new teammates. The effectiveness of the algorithm is demonstrated on three domains, ranging from multi-armed bandits to simulated robot soccer games.

List of contents

Introduction.- Problem Description.- Background.- Related Work.- The PLASTIC Algorithms.- Theoretical Analysis of PLASTIC.- Empirical Evaluation.- Discussion and Conclusion.

Summary

This book is devoted to the encounter and interaction of agents such as robots with other agents and describes how they cooperate with their previously unknown teammates, forming an Ad Hoc team. It presents a new algorithm, PLASTIC, that allows agents to quickly adapt to new teammates by reusing knowledge learned from previous teammates. PLASTIC is instantiated in both a model-based approach, PLASTIC-Model and a policy-based approach, PLASTIC-Policy. In addition to reusing knowledge learned from previous teammates, PLASTIC also allows users to provide expert-knowledge and can use transfer learning (such as the new Two Stage Transfer algorithm) to quickly create models of new teammates when it has some information about its new teammates. The effectiveness of the algorithm is demonstrated on three domains, ranging from multi-armed bandits to simulated robot soccer games.

Product details

• Authors: Samuel Barrett
• Publisher: Springer, Berlin
• Languages: English
• Product format: Hardback
• Released: 01.01.2015
• EAN: 9783319180687
• ISBN: 978-3-31-918068-7
• No. of pages: 144
• Dimensions: 170 mm x 8 mm x 241 mm
• Weight: 362 g
• Illustrations: XX, 144 p. 26 illus., 7 illus. in color.
• Series: Studies in Computational Intelligence; Studies in Computational Intelligence
• Subjects: Natural sciences, medicine, IT, technology > Technology > General, dictionaries; B, Robotics, Artificial Intelligence, Automation, engineering, Game Theory, Economics, Social and Behav. Sciences, game theory, Complex systems, Ecological science, the Biosphere, Social research & statistics, Computational Intelligence, Control, Robotics, Automation, Robotics and Automation, Econophysics, Sociophysics, Data-driven Science, Modeling and Theory Building