Apache Spark 2 - Spark Architecture and Execution Modes

As part of the course Apache Spark 2 using Python 3, let us understand details about Spark Architecture, Data Structures, Execution Modes etc.

itversiry LMS course(CCA 175 Spark and Hadoop Developer – Python – 93 Days Lab):

* Spark Modules
* Spark Data Structures - RDD and Data Frames
* Spark Framework
* Driver Program
* Spark Context
* Executors
* Executor Cache
* Executor Tasks
* Job
* Stage etc
* Execution Modes
* Local
* Stand Alone
* YARN
* Mesos

On our YouTube channel we conduct live sessions regularly. Please do subscribe to get notifications for our live sessions by clicking here.

For quick itversity updates, subscribe to our newsletter or follow us on social platforms.

#Python #PySpark #Spark2 #itversity #Spark #DataEngineering

Join this channel to get access to perks:

[rahulsood]

There's no flow. The instructor keeps wandering here and there, without coming to the point.

[KrishnaveniKatte]

@33:50 to cal the sum
from pyspark.sql.functions import sum
==

[Ramkrishna-vizn]

@33:50 to calculate the sum of order_items_order_id==2 is "sum"}).collect()

[animeshasansol]

You are an awesome tutor, very detailed, the best so far on spark using python.

[rakeshsahoo]

Can we ryt same in Pycharm in windows ryt ...??