Spark SQL UDF | Avoid UDF in Spark | Part -2 | LearntoSpark

preview_player
Показать описание
In this Video, we will learn why we need to avoid using UDF in Spark application. We will have a demo on both scala and python. Hope this video will be helpful in your interview preparation.
Рекомендации по теме
Комментарии
Автор

Very well clearly explained why to avoid using udfs, Thanks a lot!

vedantmaharaj
Автор

Practically watching why we should not use UDF is awesome. Keep it up

rikuntri
Автор

it is working when we use that udf in another def function block.. please help me why it is not working.. i am getting no named module error.

mohans
Автор

How to calculate number of partitions required for a 10 GB of data, and for repartitioning and coalesce please help??

MrManish