Spark - Repartition Or Coalesce

preview_player
Показать описание
#spark #repartition

Video Playlist
-----------------------

YouTube channel link

Website
Technology in Tamil & English
Рекомендации по теме
Комментарии
Автор

is it because of we are dealing with less data?, if data grows then we can actually compare the results, thoughts ?

techtransform
Автор

Bro....i am eagerly waiting for upload continuously

nagarajareddykorsipati
Автор

You are the kickstarter my journey in DE,

So while watching these video, i am not able to get some methods u using, so do i need to go some beginer level than this, eg: toDF and lit in DF1 are unable to get what is ur suggesstion? like the way i missed some code areas when describe about spark custom partition with (extends u used at clas my Custom Partition_

Growth__Hub_
Автор

Brother ... repartition solves the data skewness... ? whether it distributes the key to other partitions if it exceeds the size ?

sunilprasathe
Автор

can you post on, working with small file in spark .how to fix or enhance the performance?

justvenkyy...