Experimentation in Software Engineering

Like other sciences and engineering disciplines, software engineering requires a cycle of model building, experimentation, and learning. Experiments are valuable tools for all software engineers who are involved in evaluating and choosing between different methods, techniques, languages and tools.
The purpose of Experimentation in Software Engineering is to introduce students, teachers, researchers, and practitioners to empirical studies in software engineering, using controlled experiments. The introduction to experimentation is provided through a process perspective, and the focus is on the steps that we have to go through to perform an experiment. The book is divided into three parts. The first part provides a background of theories and methods used in experimentation. Part II then devotes one chapter to each of the five experiment steps: scoping, planning, execution, analysis, and result presentation. Part III completes the presentation with two examples. Assignments and statistical material are provided in appendixes. Overall the book provides indispensable information regarding empirical studies in particular for experiments, but also for case studies, systematic literature reviews, and surveys. It is a revision of the authors' book, which was published in 2000. In addition, substantial new material, e.g. concerning systematic literature reviews and case study research, is introduced.
The book is self-contained and it is suitable as a course book in undergraduate or graduate studies where the need for empirical studies in software engineering is stressed. Exercises and assignments are included to combine the more theoretical material with practical aspects. Researchers will also benefit from the book, learning more about how to conduct empirical studies, and likewise practitioners may use it as a "cookbook" when evaluating new methods or techniques before implementing them in their organization.

List of contents

Part I Background.- Introduction.- Empirical Strategies.- Measurement.- Systematic Literature Reviews.- Case Studies.- Experiment Process.- Part II Steps in the Experiment Process.- Scoping.- Planning.- Operation.- Analysis and Interpretation.- Presentation and Package.- Part III Example Experiments.- Experiment Process Illustration.- Are the Perspectives Really Different?.- Appendices.- Exercises.- Statistical Tables.

About the author

Prof. Claes Wohlin is a professor in Software Engineering at the School of Engineering at Blekinge Institute of Technology in Sweden.

Summary

Like other sciences and engineering disciplines, software engineering requires a cycle of model building, experimentation, and learning. Experiments are valuable tools for all software engineers who are involved in evaluating and choosing between different methods, techniques, languages and tools.
The purpose of Experimentation in Software Engineering is to introduce students, teachers, researchers, and practitioners to empirical studies in software engineering, using controlled experiments. The introduction to experimentation is provided through a process perspective, and the focus is on the steps that we have to go through to perform an experiment. The book is divided into three parts. The first part provides a background of theories and methods used in experimentation. Part II then devotes one chapter to each of the five experiment steps: scoping, planning, execution, analysis, and result presentation. Part III completes the presentation with two examples. Assignments and statistical material are provided in appendixes. Overall the book provides indispensable information regarding empirical studies in particular for experiments, but also for case studies, systematic literature reviews, and surveys. It is a revision of the authors’ book, which was published in 2000. In addition, substantial new material, e.g. concerning systematic literature reviews and case study research, is introduced. 
The book is self-contained and it is suitable as a course book in undergraduate or graduate studies where the need for empirical studies in software engineering is stressed. Exercises and assignments are included to combine the more theoretical material with practical aspects. Researchers will also benefit from the book, learning more about how to conduct empirical studies, and likewise practitioners may use it as a “cookbook” when evaluating new methods or techniques before implementing them in their organization.

Additional text

From the reviews:
"The revised edition includes new chapters and examples, which further cements its place as the premier book on the topics of designing, constructing, executing, and assessing experiments in software engineering. (...) The revisions will make this book even more valuable. (...) It ought to be required reading for all PhD students; every academic’s bookcase should have a copy." (Michael Oudshoorn, Computing Reviews, October, 2012)

“This book is a landmark in allowing us to train both the researcher and practitioner in software engineering experimentation.” (Victor R. Basili, University of Maryland, MD, USA)

“The additions and modifications in this revised version very nicely reflect the maturation of the field of empirical software engineering.” (Anneliese A. Andrews, University of Denver , CO, USA)
“The volume, a revised edition of a work by the same name … published in 2000, presents a very useful review of methods in software engineering research. It is structured as a textbook, making it useful for an introductory graduate-level course or a fourth-year course at the undergraduate level. Practitioners and experts will also benefit from this book, as they can use it as a starting point for more in-depth approaches. … Summing Up: Highly recommended. Upper-division undergraduates through professionals/practitioners.” (L. Benedicenti, Choice, Vol. 50 (9), May, 2013)

Report

From the reviews:
"The revised edition includes new chapters and examples, which further cements its place as the premier book on the topics of designing, constructing, executing, and assessing experiments in software engineering. (...) The revisions will make this book even more valuable. (...) It ought to be required reading for all PhD students; every academic's bookcase should have a copy." (Michael Oudshoorn, Computing Reviews, October, 2012)

"This book is a landmark in allowing us to train both the researcher and practitioner in software engineering experimentation." (Victor R. Basili, University of Maryland, MD, USA)

"The additions and modifications in this revised version very nicely reflect the maturation of the field of empirical software engineering." (Anneliese A. Andrews, University of Denver , CO, USA)
"The volume, a revised edition of a work by the same name ... published in 2000, presents a very useful review of methods in software engineering research. It is structured as a textbook, making it useful for an introductory graduate-level course or a fourth-year course at the undergraduate level. Practitioners and experts will also benefit from this book, as they can use it as a starting point for more in-depth approaches. ... Summing Up: Highly recommended. Upper-division undergraduates through professionals/practitioners." (L. Benedicenti, Choice, Vol. 50 (9), May, 2013)

Product details

• Authors: Martin Höst, Martin et al Höst, Magnus C. Ohlsson, Björn Regnell, Pe Runeson, Per Runeson, Anders Wesslén, Clae Wohlin, Claes Wohlin
• Publisher: Springer, Berlin
• Languages: English
• Product format: Hardback
• Released: 12.04.2012
• EAN: 9783642290435
• ISBN: 978-3-642-29043-5
• No. of pages: 236
• Dimensions: 155 mm x 242 mm x 20 mm
• Weight: 526 g
• Illustrations: XXIV, 236 p.
• Subject: Natural sciences, medicine, IT, technology > IT, data processing > IT