Turning HPC Systems into Interactive Data Analysis Platforms | SciPy 2019 | A. Banihirwe

preview_player
Показать описание
This talk demonstrates how to use Dask and Jupyter on large high-performance computing (HPC) systems to scale and accelerate large interactive data analysis tasks -- effectively turning HPC systems into interactive big-data platforms. We will introduce dask-jobqueue which allows users to seamlessly deploy and scale dask on HPC clusters that use a variety of job queuing systems such as PBS, Slurm, SGE, and LSF. We will also introduce dask-mpi, a Python package that makes deploying Dask easy from within a distributed MPI environment.
Connect with us!
*****************
  1. Enthought
  2. python
  3. dask
  4. scipy
  5. HPC
  6. Jupyter
Рекомендации по теме
Turning HPC Systems 0:29:29

Turning HPC Systems into Interactive Data Analysis Platforms | SciPy 2019 | A. Banihirwe

Demonstration of running 0:25:16

Demonstration of running parallel jobs on TACC HPC Systems

New User Training 1:00:37

New User Training for HPC Systems

2023 New User 1:32:52

2023 New User Training for HPC Systems

Dask on HPC 0:31:04

Dask on HPC Introduction

Containerised applications on 0:56:46

Containerised applications on the HPC cluster

Connecting to HPC 0:10:14

Connecting to HPC Resources

HPC and Scheduling 0:32:49

HPC and Scheduling for Realtime Systems (FMX2015)

2.4 Interactive jobs 0:47:04

2.4 Interactive jobs - Getting started with scientific computing/HPC (winter 2022)

Enabling AI/DL on 0:45:24

Enabling AI/DL on HPC Infrastructure through Containers and Open OnDemand

Jupyter as the 1:18:08

Jupyter as the Interface to High Performance Computing

Interactive Computing 0:48:03

Interactive Computing

Introduction to Computing 0:18:03

Introduction to Computing Clusters

Modernizing HPC Systems 0:46:36

Modernizing HPC Systems with Auto-Scaler Technology to Improve Performance and Throughput

Overview of the 0:15:50

Overview of the Dell EMC HPC System for Manufacturing

HPC Next – 1:15:30

HPC Next – Intro to modern HPC and computing/analysis tools for Research and Education

Interactive Supercomputing with 0:13:43

Interactive Supercomputing with Dask-Jobqueue, Dask, and Jupyter

Webinar | Interactive 0:38:34

Webinar | Interactive High-Performance Computing using ThinLinc

Three ways to 0:28:46

Three ways to use slurm on a high performance computer (HPC) (CC130)

AWS re:Invent 2020: 0:23:59

AWS re:Invent 2020: HPC on AWS: Innovating without infrastructure constraints

Using Containers to 1:30:20

Using Containers to Accelerate HPC

Introduction to HPC 1:54:15

Introduction to HPC Colonial One

SDSC HPC/CI Training 0:44:14

SDSC HPC/CI Training Series 2022 - Week 1

Webinar 026: Containers 1:02:07

Webinar 026: Containers in HPC

Комментарии
Автор

Part of the title seems to be missing here... "Turning HPC Systems" ?

remram