Data Engineering using Spark SQL - Basic Transformations - Basic Transformations - Introduction

preview_player
Показать описание
As part of this section we will see basic transformations we can perform on top of Data Frames such as filtering, aggregations, joins etc using SQL. We will build end to end solution by taking a simple problem statement.

🔵Click below to get access to the course with one month lab access for "Data Engineering Essentials Hands-on - SQL, Python and Spark" -

=============================================
More top rated #DataEngineering Courses from #itversity 👇🏻
_____________________________________________________

🟢Data Engineering using AWS Analytics Services

🟢Data Engineering using Databricks features on AWS and Azure

🟢Data Engineering using Kafka and Spark Structured Streaming (NEW)

==============================================
For quick itversity updates, subscribe to our newsletter or follow us on social platforms.

#Spark #Python #DataEngineeringEssentials #SQL #BigData

🟡Join this channel to get access to perks:
  1. itversity
  2. data engineering vs data science
  3. knowledge and data engineering
  4. data flow diagram in software engineering
  5. data science vs software engineering
  6. data dictionary in software engineering
Рекомендации по теме
The five levels 0:03:00

The five levels of Apache Spark - Data Engineering

Data Engineering using 0:03:20

Data Engineering using Spark SQL - Getting Started - Running OS Commands using Spark SQL

Data Engineering using 0:08:40

Data Engineering using Spark SQL - Getting Started - Exercise - Getting Started with Spark SQL

Data Engineering using 0:04:12

Data Engineering using Spark SQL - Getting Started - Launching and using Spark SQL CLI

Data Engineering using 0:02:08

Data Engineering using Spark SQL - Getting Started - Getting Started - Overview

Data Engineering using 0:06:33

Data Engineering using Spark SQL - Basic Transformations - Spark SQL - Overview

Data Engineering using 0:08:40

Data Engineering using Spark SQL - Getting Started - Overview of Spark SQL Properties

Data Engineering using 0:04:06

Data Engineering using Spark SQL - Getting Started - Understanding Warehouse Directory

Data Engineering using 0:03:24

Data Engineering using Spark SQL - Getting Started - Managing Spark Metastore Tables

Data Engineering using 0:09:08

Data Engineering using Spark SQL - Getting Started - Managing Spark Metastore Databases

Data Engineering using 0:10:25

Data Engineering using Spark SQL - Basic Transformations - Aggregating Data

Azure Databricks Tutorial: 0:07:54

Azure Databricks Tutorial: Using the QUALIFY Keyword in Spark SQL | Data Engineering Guide 2024

Spark SQL for 0:14:57

Spark SQL for Data Engineering 13: Spark SQL Delta Restore Operations #sparksql #deltalake

Advantages of PARQUET 0:00:44

Advantages of PARQUET FILE FORMAT in Apache Spark | Data Engineer Interview Questions #interview

Data Engineering using 0:07:14

Data Engineering using Spark SQL - Basic Transformations - Joining Tables - Inner

Learn Apache Spark 0:10:47

Learn Apache Spark in 10 Minutes | Step by Step Guide

Difference b/w Pandas 0:01:01

Difference b/w Pandas & PySpark. #dataengineering #bigdata #spark #interview #preparation

The 2025 learn 0:00:58

The 2025 learn Data Engineering roadmap from scratch!

Spark SQL vs 0:00:14

Spark SQL vs Dataframes #apachespark #spark #dataengineering

How to Build 0:08:32

How to Build ETL Pipelines with PySpark? | Build ETL pipelines on distributed platform | Spark | ETL

Data Engineering using 0:03:20

Data Engineering using Spark SQL - Basic Transformations - Basic Transformations - Introduction

Cluster Configuration in 0:01:00

Cluster Configuration in Apache Spark | Thumb rule fo optimal performance #interview #question

SQL For Big 3:59:08

SQL For Big Data Engineering [Full Course 2025]

Some Techniques to 0:00:43

Some Techniques to Optimize Pyspark Job | Pyspark Interview Question| Data Engineer

visit shbcf.ru