Thrill YouTube Tutorial: High-Performance Algorithmic Distributed Computing with C++

preview_player
Показать описание

Table of Contents:
--- Thrill Motivation Pitch ---
0:04:08 Benchmarks and Introduction
0:15:08 Tutorial: Clone, Compile, and Run Hello World
--- Introduction to Parallel Machines ---
0:20:20 The Real Deal: Examples of Machines
0:24:50 Networks: Types and Measurements
0:27:02 Round Trip Time (RTT) and Bandwidth
0:29:19 MPI Random Async Block Benchmark
0:31:47 Models
0:35:58 Implementations and Frameworks
--- The Thrill Framework ---
0:39:28 Thrill's DIA Abstraction and List of Operations
0:44:00 Illustrations of DIA Operations
0:55:32 Tutorial: Playing with DIA Operations
1:08:21 Execution of Collective Operations in Thrill
1:21:10 Tutorial: Running Thrill on a Cluster
1:27:02 Tutorial: Logging and Profiling
1:32:14 Going Deeper into Thrill
1:32:49 Layers of Thrill
1:37:59 File - Variable-Length C++ Item Store
1:43:54 Readers and Writers
1:46:43 Thrill's Communication Abstraction
1:48:07 Stream - Async Big Data All-to-All
1:49:46 Thrill's Data Processing Pipelines
1:51:29 Thrill's Current Sample Sort
1:54:14 Optimization: Consume and Keep
1:59:34 Memory Allocation Areas in Thrill
2:01:17 Memory Distribution in Stages
2:02:22 Pipelined Data Flow Processing
2:08:48 ReduceByKey Implementation
2:12:06 Tutorial: First Steps towards k-Means
2:35:56 Conclusion

After introducing the audience to Thrill we guide participants through the initial steps of downloading and compiling the software package. The tutorial then continues to give an overview of the challenges of programming real distributed machines and models and frameworks for achieving this goal. With these foundations, Thrill's DIA programming model is introduced with an extensive listing of DIA operations and how to actually use them. The participants are then given a set of small example tasks to gain hands-on experience with DIAs.

After the hands-on session, the tutorial continues with more details on how to run Thrill programs on clusters and how to generate execution profiles. Then, deeper details of Thrill's internal software layers are discussed to advance the participants' mental model of how Thrill executes DIA operations. The final hands-on tutorial is designed as a concerted group effort to implement K-means clustering for 2D points.
Рекомендации по теме
Комментарии
Автор

My man has been uploading quality content for 8 damn years... what a Chad.

-TaxFraud-
Автор

"Make computer software fast again!" :)

cybernessful
Автор

Thanks man, really helped. Hope ill be like you 1 day

pieTone
Автор

Looks and sounds cool but I don’t understand any of it XD

stresslevel
Автор

This is a certified moment of all time

ImBowsa
Автор

Surprised to see Spark Streaming, but not Flink for real-time processing since for Flink real-time processing considered to be a 1-class citizen.

cybernessful
Автор

Me:Man, programing seems interesting!!I should try learning for a future job!!
Youtube:Here is an over 2 hours long video to remember you are too dumb for this!

maestrulgamer