2021 High Performance Computing Lecture 5 Parallel Algorithms and Data Structures Part2 💻

Lecture 5 - Parallel Algorithms and Data Structures 🖥️ - Part Two

Advanced Scientific Computing
16 university lectures with additional practical lectures for hands-on exercises in context
University of Iceland, School of Engineering and Natural Sciences
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science

Spring 2021

Course Outline
1. High Performance Computing
2. Parallel Programming with MPI
3. Parallelization Fundamentals
4. Advanced MPI Techniques
5. Parallel Algorithms & Data Structures
6. Parallel Programming with OpenMP
7. Hybrid Programming & Patterns
8. Debugging & Profiling & Performance Analysis
9. Accelerators & Graphical Processing Units
10. Parallel & Scalable Machine & Deep Learning
11. HPC in Health & Neurosciences
12. Computational Fluid Dynamics & Finite Elements
13. Systems Biology & Bioinformatics
14. Molecular Systems & Material Sciences
15. Terrestrial Systems & Climate
16. Epilogue

Lecture Outline

Part One: Selected Parallel Algorithms
Vector Addition in MPI using MPI Collectives
Matrix – Vector Multiplication using MPI Collectives
Fast Fourier Transform (FFT) Library Tool using MPI Communicators
Using Non-Blocking Communication in Simulation Sciences
Advanced Parallel & Scalable Algorithm Examples in Context

Part Two: Selected Data Structures
Domain Decompositions & Tree-based Structures with Particle Interaction Examples
Basic MPI Datatypes and Arrays & Multi-dimensional Datasets
Derived MPI Datatypes & Small Illustrative Examples
Relationships to Parallel IO & Hierarchical Data Format (HDF)
Data Science example using Parallel I/O for ‘Big Data‘ Clustering