UAI 2016 Tutorial: Parallel and High-performance Computing for Machine Learning

Parallel and High-performance Computing for Speeding up Machine Learning Algorithms

Anshul Gupta, IBM T.J. Watson Research Center; Prabhanjan Kambadur, Bloomberg L.P.

This talk gives a generic introduction to parallel and high-performance computing, including hardware, parallel programming models, parallel programming tools, and most common challenges and pitfalls. We will also discuss performance and scalability metrics, parallel algorithm analysis, and the importance of such analysis. We will illustrate some of the parallelization and analysis techniques with a case study involving a machine learning software.