Read more
Kim Marriott Bernd Meyer Communication is one of the hallmarks of humans. When we think of hu man communication, most people first think of spoken and written lan guages. These are similar in that symbols in the language are encountered and processed sequentially, either temporally as they are spoken or as char acters are read across a page. However, not all human communication is sequential in nature. Important components of human communication are visual languages, such as maps or diagrams. In these languages the basic symbols are not encountered sequentially but rather seen together at a glance. Visual languages are ubiquitous in human cultures, ranging from tradi tional paintings of central Australian aborigines which are, in part, maps of the countryside to an architect's design of a new building. Visual languages have been employed from earliest pre-history to the present and are used in almost every human endeavor. They cover the entire spectrum of human expression ranging from fine art, such as an abstract expressionist's private language, to precise technical communication using rigorously defined no tation, such as musical notation, mathematical notation, or street maps. Some visual languages, such as sign languages used by the deaf community, substitute spoken language entirely. Indeed, sign languages, for example American Sign Language, are a particularly interesting instance of visual communication, since they use three-dimensional spatial arrangements of signs in combination with their sequential temporal order to constitute meaning.
List of contents
1 Introduction.- 2 A Survey of Visual Language Specification and Recognition.- 3 Visual Language Theory: Towards a Human Computer Interaction Perspective.- 4 The CCMG Visual Language Hierarchy.- 5 Positional Grammars: A Formalism for LR-Like Parsing of Visual Languages.- 6 Relational Grammars: Theory and Practice in a Visual Language Interface for Process Modeling.- 7 Relation Grammars: A Formalism for Syntactic and Semantic Analysis of Visual Languages.- 8 How to Represent a Visual Specification.- 9 A Fully Formalized Theory for Describing Visual Notations.- 10 On the Isomorphism, or Lack of It, of Representations.- 11 A Syntax-Directed Approach to Picture Semantics.- 12 Input and Output for Specified Visual Languages.- 13 Specification of Visual Languages as Means for Interaction.
