2021 High Performance Computing Lecture 2 Parallel Programming with MPI Part2 💻

Lecture 2 - Parallel Programming with MPI 🖥️ - Part Two

Advanced Scientific Computing
16 university lectures with additional practical lectures for hands-on exercises in context
University of Iceland, School of Engineering and Natural Sciences
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science

Spring 2021

Course Outline
1. High Performance Computing
2. Parallel Programming with MPI
3. Parallelization Fundamentals
4. Advanced MPI Techniques
5. Parallel Algorithms & Data Structures
6. Parallel Programming with OpenMP
7. Hybrid Programming & Patterns
8. Debugging & Profiling & Performance Analysis
9. Accelerators & Graphical Processing Units
10. Parallel & Scalable Machine & Deep Learning
11. HPC in Health & Neurosciences
12. Computational Fluid Dynamics & Finite Elements
13. Systems Biology & Bioinformatics
14. Molecular Systems & Material Sciences
15. Terrestrial Systems & Climate

16. Epilogue

Lecture Outline

Part One: Message Passing Interface (MPI) Concepts
Terminologies & Parallel Computing Application Examples
Distributed Memory Computers & MPI Standard for Portability
MPI Implementations & Point-to-Point Message Passing Functions
Understanding MPI Collectives with Simple Computing Examples
Using MPI Ranks & Communicators

Part Two: MPI Parallel Programming Basics
Jötunn HPC Environment with Libraries & Modules
Thinking Parallel & Step-wise Walkthrough for Parallel Programming
Basic Building Blocks of a Parallel Program & Code Compilation
Understanding Parallel Executions & PingPong Application Example
Application Example Computing PI in Serial vs. Parallel & AllGather

[UniverseGames]

xrange doesn't work on Python 3.8, seems version issues. Any suggestions, as I checked but can't fix this issue so far with some workaround online.