PySpark Examples - How to join DataFrames (inner, left, right, outer, anti) - Spark SQL

Spark SQL Join
We use Join in spark to combine records from two data frame based on joining condition.

Join Types
Inner Join :
Output of Inner join will have
- matched records from both data frame.

Left Join :
Output of Left join will have
- matched records from both data frame
- un-matched from left data frame
(For such records columns from right data frame will have "null" value)

Right Join :
Output of Right join will have
- matched records from both data frame
- un-matched from right data frame
(For such records columns from left data frame will have "null" value)

Outer Join :
Output of Outer join will have
- matched records from both data frame
- un-matched from left data frame
(For such records columns from right data frame will have "null" value)
- un-matched from right data frame
(For such records columns from left data frame will have "null" value)

Left Anti Join :
Output of Left Anti join will have
- un-matched from left data frame

#pyspark #spark #python #sparksql #dataframe #join #inner #outer #left #right #leftanti

[tcsanimesh]

Hello do you provide pyspark training?