Learning by doing :: MPI -- Parallel Hello, World! With MPI

This video is part of the new series called "Learning by doing :: MPI" which serves as an introductory course on MPI (Message Passing Interface). In this video we tried to write our very first parallel application with MPI to print Hello, World! from different processes. This video in particular got lengthier than expected because we had to go over some basics such as MPI_Init, MPI_Comm_rank, MPI_Comm_size, MPI_COMM_WORLD and MPI_Finalize. MPI_Init(&argc, &argv) must be called in every parallel application written with MPI cause it sets up the environment for our MPI communications. MPI_Finalize() also must be called at the end of our application to make sure that we clean after ourselves. We tried to use both C and C++ to achieve the same task of printing Hello, World! from different processes. We might opt to use C more often than C++ because we already have dedicated series of videos to C++! + MPI bindings are written for C! Better we brush up our knowledge on C as well!
Moreover, we also learned about the notion of SPMD (single program multiple data) and MPMD(multiple program multiple data). And finally in the end, we visited the standard to take a look at some interesting parts in chapter 1.

* this link contains v5.0.3 as being the latest version at the time but you can select the desired version from the panel on the left.

Hope you learned something from this video. If you have further questions don't hesitate to comment down below. Have fun!