Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems

The book provides a timely coverage of the paradigm of knowledge distillation-an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacher-student architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including researchers and practitioners active in the area of machine learning and pursuing fundamental and applied research in the area of advanced learning paradigms.

List of contents

Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation.- A Geometric Perspective on Feature-Based Distillation.- Knowledge Distillation Across Vision and Language.- Knowledge Distillation in Granular Fuzzy Models by Solving Fuzzy Relation Equations.- Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications.- Self-Distillation with the New Paradigm in Multi-Task Learning.- Knowledge Distillation for Autonomous Intelligent Unmanned System.

Product details

• Assisted by: Chen (Editor), Shyi-Ming Chen (Editor), Witold Pedrycz (Editor)
• Publisher: Springer, Berlin
• Languages: English
• Product format: Hardback
• Released: 01.10.2023
• EAN: 9783031320941
• ISBN: 978-3-0-3132094-1
• No. of pages: 232
• Dimensions: 155 mm x 17 mm x 235 mm
• Illustrations: VIII, 232 p. 70 illus., 51 illus. in color.
• Series: Studies in Computational Intelligence
• Subject: Natural sciences, medicine, IT, technology > Technology > General, dictionaries