Lectures on Parallel Computing

This textbook is intended for an undergraduate course on the fundamentals of parallel computing or as a background and reference for graduate courses on high-performance computing, shared-memory multiprocessor programming, or parallel algorithms.
The author introduces theoretical concepts and tools for expressing, analyzing, and assessing parallel algorithms, and covers in detail the two most widely used concrete frameworks, OpenMP and MPI, plus the threading interface pthreads for writing parallel programs for either shared or distributed memory parallel computers with an emphasis on general concepts and principles. Code examples are given in a C-like style, and the extensive exercises can be used for self-study and as inspiration for small implementation projects in OpenMP and MPI.
The book is appropriate for students and professionals engaged in all aspects of parallel computing.
 

List of contents

Introduction to Parallel Computing: Architectures and Models, Algorithms and Measures.- Shared Memory Parallel Systems and OpenMP.- Distributed Memory Parallel Systems and MPI.- Appendix A, Proofs and Supplementary Material.- References.- Index.

Product details

• Authors: Jesper Larsson Träff
• Assisted by: Jesper Larsson Träff (Editor), Jesper Larsson Träff (Editor)
• Publisher: Springer, Berlin
• Languages: English, German
• Product format: Paperback / Softback
• Release: 01.10.2025
• EAN: 9783031865770
• ISBN: 978-3-0-3186577-0
• No. of pages: 320
• Illustrations: Approx. 320 p.
• Series: Lecture Notes in Computer Science
• Subjects: Natural sciences, medicine, IT, technology > IT, data processing > IT; MPI, Netzwerk-Hardware, Rechnerarchitektur und Logik-Entwurf, Numerische Mathematik, Concurrency, Distributed Computing, Computer Communication Networks, Computational Science and Engineering, Processor Architectures, Special Purpose and Application-Based Systems, Pthreads, parallel computing, multicore systems, memory models, Cilk, OpenMP, PRAM Model, Pipeline Parallelism