Read more
Multimedia Communication is ubiquitous in daily life. When we converse with one another, we utilize a wide array of media to interact, including spoken language, gestures, and drawings. We exploit multiple sensory systems or modes of communication including vision, audition, and taction. Although humans have a natural facility for managing and exploiting multiple input and output media, computers do not. Consequently, providing machines with the ability to interpret multimedia input and generate multimedia output would be a valuable facility for a number of key applications such as information retrieval and analysis, training, and decision support. This book focuses specifically on those intelligent interfaces that exploit multiple media and modes to facilitate human-computer communication. As a consequence, this edited collection will be of interest to researchers and practitioners in computer science, artificial intelligence, computer-human interaction, cognitive science, and graphic design.
List of contents
Part 1 Automated presentation design: intelligent multimedia presentation systems - research and principles, Steven F. Roth and William E. Hefley; planning multimedia explanations using communicative acts, Mark T. Maybury; WIP - the automatic synthesis of multimodal presentations, Elisabeth Andre et al; the design of illustrated documents as a planning task, Elisabeth Andre and Thomas Rist; automating the generation of coordinated multimedia explanations, Steven K. Feiner and Kathleen R. McKeown; towards coordinated temporal multimedia presentations, Steven K. Feiner et al; multimedia explanations for intelligent training systems, Bradley A. Goodman. Part 2 Intelligent multimedia interfaces: the application of natural language models to intelligent multimedia, John D. Burger and Ralph J. Marshall; ALFRESCO - enjoying the combination of natural language processing and hypermedia for information exploration, Oliviero Stock et al; an approach to hypermedia in diagnostic systems, Suhayya Abu-Hakima et al; integrating simultaneous input from speech, gaze and hand gestures, David B. Koons et al. Part 3 Architectural and theoretical issues: on the knowledge underlying multimedia presentations, Yigal Arens et al; using "live information" in a multimedia framework, Matthew Cornell et al; a multilayered empirical approach to multimodality - towards mixed solutions of natural language and graphical interfaces, Jurgen Krause; modelling issues in multimedial car-driver interaction, Andrea Bonarini.
About the author
Mark T. Maybury is Executive Director of the Information Technology Division at the MITRE Corporation in Bedford, Massachusetts. He is the editor of Intelligent Multimedia Interfaces (AAAI/MIT Press 1993) and Intelligent Multimedia Information Retrieval (AAAI/ MIT Press 1997) and coeditor of Readings on Intelligent User Interfaces, Advances in Text Summarization (MIT Press 1999), and Advances in Knowledge Management (MIT Press 2001).
Summary
This collection of original contributions reports on key advances in intelligent (knowledge-based) user interfaces that exploit multiple media - text, graphics, maps - and multiple modalities - visual, auditory, gestural - to facilitate human-computer interaction.
