Language and Computers

Informationen zum Autor Markus Dickinson is Assistant Professor at the Department of Linguistics, Indiana University and currently the director of the Computational Linguistics program. His research focuses on improving linguistic annotation for natural language processing technology and automatically analyzing the language of second language learners.Chris Brew is a Senior Research Scientist with the Educational Testing Service in Princeton, where he is currently the scientific lead for the c-rater project on automated short answer grading. He has been active in Natural Language Processing for over 20 years, first in the UK, then as Associate Professor of Linguistics and Computer Science at The Ohio State University, where he co-directed the Speech and Language Technologies Laboratory, as well as the Computational Linguistics Program.Detmar Meurers is Professor of Computational Linguistics and head of the Theoretical Computational Linguistics group at the University of Tübingen. He has a longstanding commitment to teaching Computational Linguistics and Linguistics in a way that combines current technology and research issues with the fundamentals of the field. His research emphasizes the role of linguistic insight and linguistic models in Computational Linguistics. His most recent research adds a focus on theory and applications related to second language acquisition. Klappentext The widening use of computers has powerfully influenced the way people communicate, search and store information. For the majority of individuals and situations, the primary vehicle for such information is natural language, and text and speech are crucial encoding formats for the information revolution.This book introduces students to the fundamentals of how computers are used to represent, process, and organize textual and spoken information. It allows students to effectively understand how the computer works and where the problems arise with the involvement of natural language. Self-contained chapters cover the central analytical concepts and provide students with tips on how to effectively integrate this knowledge into their working practice.The authors ground the concepts and analyses covered in the text in real-world examples familiar to students. Drawing on these examples, the authors teach students how to produce evidence-based analyses and arguments about language. The result is a book that teaches students to generate, justify and argue for valid conclusions about the design, capabilities and behavior of natural language systems. Zusammenfassung Language and Computers introduces students to the fundamentals of how computers are used to represent, process, and organize textual and spoken information. Concepts are grounded in real-world examples familiar to students experiences of using language and computers in everyday life. Inhaltsverzeichnis What This Book Is About xiOverview for Instructors xiiiAcknowledgments xvii1 Prologue : Encoding Language on Computers 11.1 Where do we start? 11.1.1 Encoding language 21.2 Writing systems used for human languages 21.2.1 Alphabetic systems 31.2.2 Syllabic systems 61.2.3 Logographic writing systems 81.2.4 Systems with unusual realization 111.2.5 Relation to language 111.3 Encoding written language 121.3.1 Storing information on a computer 121.3.2 Using bytes to store characters 141.4 Encoding spoken language 171.4.1 The nature of speech 171.4.2 Articulatory properties 181.4.3 Acoustic properties 181.4.4 Measuring speech 20Under the Hood 1: Reading a spectrogram 211.4.5 Relating written and spoken language 24Under the Hood 2: Language modeling for automatic speech recognition 262 Writers' Aids 332.1 Introduction 332.2 Kinds of spelling errors 342.2.1 Nonword errors 352.2.2 Real-word errors 372.3 Spell checkers 382.3.1 Nonword error detection 392.3.2 Isolated-word spelling correction 41Under th...

List of contents

What This Book Is About xi
 
Overview for Instructors xiii
 
Acknowledgments xvii
 
1 Prologue : Encoding Language on Computers 1
 
1.1 Where do we start? 1
 
1.1.1 Encoding language 2
 
1.2 Writing systems used for human languages 2
 
1.2.1 Alphabetic systems 3
 
1.2.2 Syllabic systems 6
 
1.2.3 Logographic writing systems 8
 
1.2.4 Systems with unusual realization 11
 
1.2.5 Relation to language 11
 
1.3 Encoding written language 12
 
1.3.1 Storing information on a computer 12
 
1.3.2 Using bytes to store characters 14
 
1.4 Encoding spoken language 17
 
1.4.1 The nature of speech 17
 
1.4.2 Articulatory properties 18
 
1.4.3 Acoustic properties 18
 
1.4.4 Measuring speech 20
 
Under the Hood 1: Reading a spectrogram 21
 
1.4.5 Relating written and spoken language 24
 
Under the Hood 2: Language modeling for automatic speech recognition 26
 
2 Writers' Aids 33
 
2.1 Introduction 33
 
2.2 Kinds of spelling errors 34
 
2.2.1 Nonword errors 35
 
2.2.2 Real-word errors 37
 
2.3 Spell checkers 38
 
2.3.1 Nonword error detection 39
 
2.3.2 Isolated-word spelling correction 41
 
Under the Hood 3: Dynamic programming 44
 
2.4 Word correction in context 49
 
2.4.1 What is grammar? 50
 
Under the Hood 4: Complexity of languages 56
 
2.4.2 Techniques for correcting words in context 58
 
Under the Hood 5: Spell checking for web queries 62
 
2.5 Style checkers 64
 
3 Language Tutoring Systems 69
 
3.1 Learning a language 69
 
3.2 Computer-assisted language learning 71
 
3.3 Why make CALL tools aware of language? 73
 
3.4 What is involved in adding linguistic analysis? 76
 
3.4.1 Tokenization 76
 
3.4.2 Part-of-speech tagging 78
 
3.4.3 Beyond words 80
 
3.5 An example ICALL system: TAGARELA 81
 
3.6 Modeling the learner 83
 
4 Searching 91
 
4.1 Introduction 91
 
4.2 Searching through structured data 93
 
4.3 Searching through unstructured data 95
 
4.3.1 Information need 95
 
4.3.2 Evaluating search results 96
 
4.3.3 Example: Searching the web 97
 
4.3.4 How search engines work 100
 
Under the Hood 6: A brief tour of HTML 103
 
4.4 Searching semi-structured data with regular expressions 107
 
4.4.1 Syntax of regular expressions 108
 
4.4.2 Grep: An example of using regular expressions 110
 
Under the Hood 7: Finite-state automata 112
 
4.5 Searching text corpora 115
 
4.5.1 Why corpora? 116
 
4.5.2 Annotated language corpora 117
 
Under the Hood 8: Searching for linguistic patterns on the web 118
 
5 Classifying Documents : From Junk Mail Detection to Sentiment Classification 127
 
5.1 Automatic document classification 127
 
5.2 How computers "learn " 129
 
5.2.1 Supervised learning 130
 
5.2.2 Unsupervised learning 131
 
5.3 Features and evidence 131
 
5.4 Application: Spam filtering 133
 
5.4.1 Base rates 135
 
5.4.2 Payoffs 139
 
5.4.3 Back to documents 139
 
5.5 Some types of document classifiers 140
 
5.5.1 The Naive Bayes classifier 140
 
Under the Hood 9: Naive Bayes 142
 
5.5.2 The perceptron 145
 
5.5.3 Which classifier to use 148
 
5.6 From classification algorithms to context of use 149
 
6 Dialog Systems 153
 
6.1 Computers that "converse"

Report

"...a broad introduction is also needed byBachelor's students in linguistics, and by those studying tobecome language consultants, translators, and so on. This bookwould then be the natural choice." ( ComputationalLinguistics , 2013)

"In general, I can certainly recommend "Language andComputers" as a broad introduction to language technologyaimed at the general audience and at students who are curious aboutmodern language technology." ( Mach Translat , 1March 2013)

Product details

• Authors: Chri Brew, Chris Brew, Chris (Educational Testing Service Brew, Brew Chris, Dickinson, M Dickinson, Marku Dickinson, Markus Dickinson, Markus (Indiana University Dickinson, Markus Brew Dickinson, Dickinson Markus, Detmar Meurers, Meurers Detmar
• Publisher: Wiley, John and Sons Ltd
• Languages: English
• Product format: Paperback / Softback
• Released: 05.10.2012
• EAN: 9781405183055
• ISBN: 978-1-4051-8305-5
• No. of pages: 250
• Subjects: Humanities, art, music > Linguistics and literary studies > Other languages / Other literatures; Psycholinguistik, Angewandte Linguistik, Linguistics, Sprachwissenschaften, Applied Linguistics, Psycholinguistics, Allg. Sprachwissenschaften