How to run Spark on Kubernetes like a pro

preview_player
Показать описание
the Kubernetes workshop series, we will go over how to run Spark on Kubernetes. As your company accumulates more data, it’s important to leverage all of it to develop new advanced machine learning models. And now, you can scale Spark using Kubernetes. Thanks to the new native integration between Apache Spark’s and Kubernetes, scaling data processing has never been easier. Apache Spark is a well designed high level application that can increase your data processing speed and accuracy. It can handle batch and real-time analytic and data processing workloads. This high level and efficient technology can be used with Java/Spark/Python and R. Joined with Kubernetes, you can get twice the efficiency. Kubernetes is a great engine with the most popular framework for managing compute resources. Unfortunately, running Apache Spark on Kubernetes can be a pain for first-time users.
#Kubernetes#Spark#Python#
Рекомендации по теме
Комментарии
Автор

can you please share any repo link for these yamls ?

muhammaddanishiqbal
Автор

Thanks much...Fortunately I ended up here after long quest

sunnyjain
Автор

Thank you for this content, i was looking to run spark application on Kubernetes and stumbled up on this video, can you please provide git repo for all the yaml files and also the dockerfile to builld the image. Thank you in advance

PrakashReddyK
Автор

Looking for python example in spark on kubernetes

kathirvelmuniraj
Автор

so sad that this excellent and rare (in a way) content is being delivered in a such terrible sound quality.

ashimov