How to use DataFrames and SparkSQL in Spark Tutorial

In this video I show you how to process data with spark. We use Dataframes and SparkSQL to modify and display data. We also read and write files from local storage as parquet files.
This was really fun and a quick tutorial how to work with Spark through Zeppelin notebooks.

check out the full episode 103 of the podcast for the full hour.

►Learn Data Engineering with my Data Engineering Academy:

Check out my free 100+ pages data engineering cookbook on GitHub:

Please SUPPORT WHAT YOU LIKE:

- As an Amazon Associate I earn from qualifying purchases from Amazon. Just use this link:

#plumbersofdatascience #ApacheSpark #DataEngineering