2022 High Performance Computing Lecture 7 Hybrid Programming and Patterns Part2 💻

Lecture 7 - Hybrid Programming and Patterns 🖥️ - Part Two

Advanced Scientific Computing
16 university lectures with additional practical lectures for hands-on exercises in context
The University of Iceland, School of Engineering and Natural Sciences
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science

Spring 2022

Course Outline
1. High Performance Computing
2. Parallel Programming with MPI
3. Parallelization Fundamentals
4. Advanced MPI Techniques
5. Parallel Algorithms & Data Structures
6. Parallel Programming with OpenMP
7. Hybrid Programming & Patterns
8. Debugging & Profiling & Performance Analysis
9. Accelerators & Graphical Processing Units
10. Parallel & Scalable Machine & Deep Learning
11. HPC in Health & Neurosciences
12. Computational Fluid Dynamics & Finite Elements
13. Systems Biology & Bioinformatics
14. Molecular Systems & Material Sciences
15. Terrestrial Systems & Climate
16. Epilogue

Lecture Outline
Part One: Hybrid Programming
Motivation & Memory Benefits & Programming Complexity
Programming Hybrid Systems with Vector Mode & Task Mode
Lessons Learned & Performance of Hybrid Programs
Hybrid Programming using simultanously GPUs & CPUs
Simulation Sciences & Data Science Applications in Context

Part Two: Patterns
Neareast Neighbour Communication & Cartesian Communicators
Stencil-based Iterative Methods following a Regular Structure
Jacobi 2D Application Example & Working with Halo Regions
Numerical Methods & Role of Partial Differential Equations (PDEs)
Towards Realistic Simulations – Terrestrial Systems Example