Getting Started with Serverless Spark (Dataproc) on GCP

preview_player
Показать описание
This video introduces Spark jobs and using the serverless capabilities of Google Cloud Platform's Dataproc service.

This includes:
* An introduction to Spark and its significance in large-scale data processing
* A dive into Google Cloud Platform’s Dataproc service
* A step-by-step walkthrough on setting up DataProc
* Running a PySpark job in a serverless setup

If you are a cloud, machine learning, or software engineer you’ll probably find our wide range of YouTube tutorials, demonstrations, and walkthroughs useful - please consider subscribing to support the channel.

0:00 Conceptual Overview
0:53 Service Setup
2:12 PySpark Code
3:00 Cloud Storage Bucket
3:32 Running Jobs
Рекомендации по теме
Комментарии
Автор

How do I submit a project in python.

The main file (driver) main.py and other files that main.py imports?
and other project files. requirements.txt, configs.json etc...

dante
visit shbcf.ru