PySpark for Big Data-PySpark - SQL and PySpark native SQL similar functions

preview_player
Показать описание

Рекомендации по теме
Комментарии
Автор

I like the part where a high schooler only in tenth from Chennai joined the spark session 18:29

nuafrika
Автор

Hello, I have a use case where i would like to use pyspark to move 3 million worth of records from flat files to Microsoft SQL server, right now I'm using python panda to do that and it's taking 3 hrs to finish. can you let me know by using pyspark will reduce the time significantly or not? looking forward to hearing from you asap.

pateldhruvit
visit shbcf.ru