Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness.
Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

List of contents

Introduction.- State of The Art.- MeMo Platform for Automatic Usability Evaluation.- Logging Framework for the Evaluation of Interactive Systems.- User Behaviour Model for the Evaluation of Interactive Systems.- Evaluation of User Behaviour Simulations.- Conclusions.

About the author

Summary

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness.
Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

Product details

• Authors: Stefan Hillmann
• Assisted by: Stefa Hillmann (Editor), Stefan Hillmann (Editor)
• Publisher: Springer, Berlin
• Languages: English
• Product format: Hardback
• Released: 31.12.2017
• EAN: 9783319625171
• ISBN: 978-3-31-962517-1
• No. of pages: 240
• Dimensions: 162 mm x 242 mm x 20 mm
• Weight: 520 g
• Illustrations: XXX, 240 p. 31 illus.
• Series: T-Labs Series in Telecommunication Services; T-Labs Series in Telecommunication Services
• Subjects: Natural sciences, medicine, IT, technology > Technology > Electronics, electrical engineering, communications engineering; B, engineering, Signal, Image and Speech Processing, Signal Processing, Speech processing systems, Digital and Analog Signal Processing, Image processing, User interface design & usability, User Interfaces and Human Computer Interaction, User interfaces (Computer systems)