Running Hive and Spark jobs on Amazon EMR Serverless

preview_player
Показать описание
Now in preview, Amazon EMR Serverless allows you to run big data analytics without worrying about infrastructure.

In this demo, we show how to instantly run both Spark and Hive jobs on EMR Serverless as well as how to debug the jobs in real-time using logs on Amazon S3 and the Spark History Server and Tez UI.

00:00 - Intro
01:10 - EMR Serverless Overview
02:10 - Running a Spark job
06:43 - Using the Spark History Server
11:28 - Running a Hive job
15:02 - Using the Tez UI

Рекомендации по теме
Комментарии
Автор

Thank you for this tutorial. It helped in getting a quick overview of aws serverless.

AkshatKai
Автор

This is wonderful demo video and very helpful.
We want to create & submit jobs from either Terraform or open source Airflow. But Terraform supporting only application creation where as Airflow support from V5.

Could you please share list of ways to create and run jobs.

srikanthjaggari
join shbcf.ru