Using groupBy with where conditions in PySpark | Realtime Scenario| Spark Interview Questions

preview_player
Показать описание
Hi Friends,

Sample code is checked into github:

In this video, I have explained sample PySpark code to perform group by operation with where conditions.

Please subscribe to my channel for more interesting learnings.
  1. SparklingFuture
  2. #when
  3. #when otherwise
  4. #where
  5. #where condition
  6. #condition
Рекомендации по теме
Advanced Aggregate Functions 0:06:00

Advanced Aggregate Functions in SQL (GROUP BY, HAVING vs. WHERE)

Using groupBy with 0:10:34

Using groupBy with where conditions in PySpark | Realtime Scenario| Spark Interview Questions

Lec-61: SQL Queries 0:09:12

Lec-61: SQL Queries and Subqueries (part-3) | Group By clause | Database Management System

group by clause 0:12:55

group by clause in sql | Oracle Database

SQL Tutorial 7: 0:35:33

SQL Tutorial 7: Group By, Having & ,Order By Clauses in SQL

Group By Clause 0:00:58

Group By Clause in Microsoft Access Query

Group by in 0:17:44

Group by in sql server - Part 11

Aggregate Functions, Group 0:09:25

Aggregate Functions, Group by Clause and Having Keyword in SQL ? | SQL Server Interview Questions

SQL Tutorial - 0:05:17

SQL Tutorial - 30: Using GROUP BY Clause with SQL JOINS

Power BI - 0:03:52

Power BI - GROUP BY without DAX

Finding the largest 0:02:37

Finding the largest groups with conditions after using groupby

Part 18 0:10:28

Part 18 GroupBy in LINQ

Python pandas dataframe 0:01:33

Python pandas dataframe group by based on a condition

Difference between where 0:06:36

Difference between where and having in sql server

Python Pandas if 0:04:01

Python Pandas if condition inside groupby

SQL : Can 0:01:05

SQL : Can we use group by and where condition with same fieldname

Intermediate SQL Tutorial 0:04:14

Intermediate SQL Tutorial | Partition By

pandas: filter group 0:02:33

pandas: filter group by multiple conditions?

How to write 0:01:01

How to write SQL query using Where Condition,Group By and Having Clause. #sql

python pandas groupby 0:02:52

python pandas groupby with condition

Lec-62: SQL Queries 0:11:02

Lec-62: SQL Queries and Subqueries (part-4) | Having clause | Database Management System

pandas groupby count 0:03:15

pandas groupby count if condition

SQL tutorials for 0:01:01

SQL tutorials for beginners! Group by with having and where conditions! postgres tutorials

Groupby with boolean 0:01:47

Groupby with boolean condition True in one of the columns in Pandas

Комментарии
Автор

Hi,
I had interview question like,
Need to count the no of flights,
Chennai to Bangalore or Bangalore to Chennai are in same one count..
How to get that..

While use partitionBy or groupBy its giving chennai to Bangalore seperate count and Bangalore to Chennai is giving seperate count.

Can give idea?

nwugkkd
Автор

I have one doubt y here used toDF and mentioned columns. Actually when rdd converted to dataframe at that we can use toDF. Could you please clarify my doubts

sravankumar