Read more
This new volume is the first to focus entirely on automated essay scoring and evaluation. It is intended to provide a comprehensive overview of the evolution and state-of-the-art of automated essay scoring and evaluation technology across several disciplines, including education, testing and measurement, cognitive science, computer science, and computational linguistics.
The development of this technology has led to many questions and concerns. Automated Essay Scoring attempts to address some of these questions including:
*How can automated scoring and evaluation supplement classroom instruction?
*How does the technology actually work?
*Can it improve students' writing?
*How reliable is the technology?
*How can these computing methods be used to develop evaluation tools?
*What are the state-of the-art essay evaluation technologies and automated scoring systems?
Divided into four parts, the first part reviews the teaching of writing and how computers can contribute to it. Part II analyzes actual automated essay scorers including e-raterTM, Intellimetric, and the Intelligent Essay Assessor. The third part analyzes related psychometric issues, and the final part reviews innovations in the field.
This book is ideal for researchers and advanced students interested in automated essay scoring from the fields of testing and measurement, education, cognitive science, language, and computational linguistics.
List of contents
Contents: C. Bereiter, Foreword.
M.D. Shermis, J.C. Burstein, Preface. Introduction.
Part I:Teaching of Writing.M. Myers, What Can Computers Contribute to a K-12 Writing Program?
Part II:Psychometric Issues in Performance Assessment.G.K.W.K. Chung, E.L. Baker, Issues in the Reliability and Validity of Automated Scoring of Constructed Responses.
Part III:Automated Essay Scorers.E.B. Page, Project Essay Grade: PEG.
L.S. Larkey, W.B. Croft, A Text Categorization Approach to Automated Essay Grading.
S. Elliot, Intellimetric(TM): From Here to Validity.
T.K. Landauer, D. Laham, P.W. Foltz, Automated Scoring and Annotation of Essays With the Intelligent Essay Assessor.
J. Burstein, The E-Rater(R) Scoring Engine: Automated Essay Scoring With Natural Language Processing.
Part IV:Psychometric Issues in Automated Essay Scoring.G.J. Cizek, B.A. Page, The Concept of Reliability in the Context of Automated Essay Scoring.
T.Z. Keith, Validity and Automated Essay Scoring Systems.
M.D. Shermis, K.E. Daniels, Norming and Scaling for Automated Essay Scoring.
S. Ponisciak, V. Johnson, Bayesian Analysis of Essay Grading.
Part V:Current Innovation in Automated Essay Evaluation.C. Leacock, M. Chodorow, Automated Grammatical Error Detection.
J.C. Burstein, D. Marcu, Automated Evaluation of Discourse Structure in Student Essays.
About the author
Jill C. BursteinMark D. Shermis
Summary
Automated essay scoring (AES) is a relatively new tech being used to evaluate high-&-low -stakes-performance-based-writing assessments. This book is designed to provide an overview of the progress in AES tech from a cross-disciplinary perspective.
Additional text
"If a reader is looking for an understanding of the approaches and potential of AES, this is the book to read....The authors do an excellent job of describing the philosophy and history of their approaches."
—Computational Linguistics
"...this volume covers all of the major questions and answers about computer scoring of essays. It may even convince some skeptics that computer programs can get the job done."
—Abstracts and Updates
"This is a coming-of-age book about automated essay scoring."
—Dr. Carl Bereiter
Ontario Institute for Studies in Education/University of Toronto, From the Forew
"This is an emerging field and this state-of-the-art book will contribute significantly to the field and probably be cited often in scholarly literature."
—Dr. Fritz Drasgow
University of Illinois at Urbana-Champaign
"...this book makes a very important contribution to the fields of psychometrics, expert systems, and evaluation. There has long been a need to automate the process of scoring essays...it will probably be the standard reference on its subject for years to come."
—Dr. Scott Hershberger
California State University, Long Beach
