2022 High Performance Computing Lecture 6 Parallel Programming with OpenMP Part1 💻

Lecture 6 - Parallel Programming with OpenMP 🖥️ - Part One

Advanced Scientific Computing
16 university lectures with additional practical lectures for hands-on exercises in context
The University of Iceland, School of Engineering and Natural Sciences
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science

Spring 2022

Course Outline
1. High Performance Computing
2. Parallel Programming with MPI
3. Parallelization Fundamentals
4. Advanced MPI Techniques
5. Parallel Algorithms & Data Structures
6. Parallel Programming with OpenMP
7. Hybrid Programming & Patterns
8. Debugging & Profiling & Performance Analysis
9. Accelerators & Graphical Processing Units
10. Parallel & Scalable Machine & Deep Learning
11. HPC in Health & Neurosciences
12. Computational Fluid Dynamics & Finite Elements
13. Systems Biology & Bioinformatics
14. Molecular Systems & Material Sciences
15. Terrestrial Systems & Climate
16. Epilogue

Lecture Outline

Part One: Shared-Memory Programming Concepts
OpenMP with Parallel & Serial Regions
Fork/Join & Master and Worker Threads
OpenMP Standard & Portability
Hybrid Programming Motivation & PyCOMPSs/COMPSs
OmpSs & OpenMP Data-Flow & Task-Based Evolutions

Part Two: OpenMP Parallel Programming Basics
Basic building blocks for using shared memory in practice
Local/shared variable Types & Parallelization of Loops
Synchronization & Critical vs. Single Regions
Selected Comparisons with MPI & Performance Issues
Jacobi Application Example & HPDBSCAN Clustering OpenMP Example