Scala vs. PySpark!

preview_player
Показать описание
In one of my livestreams, a viewer asked me the question: Scala or PySpark?
Which one I prefer and why, I'll answer you in this video.
Have fun!

This is a short clip of one of my Livestreams.

►Learn Data Engineering with my Data Engineering Academy:

►LEARN MORE ABOUT DATA ENGINEERING:
-Check out my free 100+ page data engineering cookbook on GitHub:

►PLEASE SUPPORT WHAT YOU LIKE:
Just use this link whenever you buy something from Amazon:

(As an Amazon Associate I earn from qualifying purchases from Amazon)
This is free of charge for you but super helpful for supporting this channel.

#datascience #dataengineering #teamdatascience
  1. Andreas Kretz
  2. skala vs pyspark
  3. data science
  4. data scientist
  5. data engineering
  6. data engineer
Рекомендации по теме
Scala vs. PySpark! 0:03:46

Scala vs. PySpark!

Apache Spark |Scala 0:13:19

Apache Spark |Scala vs Python | Scala| Python | Big Data

Should you learn 0:01:58

Should you learn Scala or Python?

Spark Tutorials - 0:13:09

Spark Tutorials - Spark Language Selection | Scala vs Python

Learn Apache Spark 0:10:47

Learn Apache Spark in 10 Minutes | Step by Step Guide

Should Data Engineers 0:02:35

Should Data Engineers learn Scala?

Python vs Scala, 0:08:02

Python vs Scala, What is the difference? pros and cons- DataMites

What Is Apache 0:02:39

What Is Apache Spark?

Spark Interview Question 0:04:27

Spark Interview Question | How you choose language in Spark | Scala or Python | LearntoSpark

What is PySpark 0:02:53

What is PySpark | Introduction to PySpark For Beginners | Intellipaat

Spark UDF | 0:16:21

Spark UDF | Using Scala and PySpark | Part - 4 | LearntoSpark

Is PySpark UDF 0:05:54

Is PySpark UDF is Slow? Why ?

1.2 Apache Spark 0:08:40

1.2 Apache Spark Tutorial | Scala vs Python| Choose language

Jacek Kołodziej - 0:28:44

Jacek Kołodziej - Development with Apache Spark: Scala vs. PySpark

PyWaw #100 - 0:34:30

PyWaw #100 - Development with Apache Spark: Scala vs. PySpark

Spark Dataframes vs 0:08:40

Spark Dataframes vs SparkSQL

PySpark Tutorial 1:49:02

PySpark Tutorial

map vs flatMap 0:19:21

map vs flatMap vs mapValues vs flatMapValues | Spark with Scala | Coding Interview questions

Apache Spark - 0:07:40

Apache Spark - Computerphile

Which is best 0:03:53

Which is best ? | Spark vs Pandas

Scala Fans Be 0:00:59

Scala Fans Be Like

Cache Vs Persist 0:08:08

Cache Vs Persist in Spark with Scala - Part 1 | Spark Interview Questions

Apache Spark / 0:17:16

Apache Spark / PySpark Tutorial: Basics In 15 Mins

Spark Basics | 0:05:12

Spark Basics | Partitions

Комментарии
Автор

The real strength of Python is its huge ecosystem of libraries and tools for every possible application, from data processing (Pandas) to machine learning (TensorFlow, Keras, etc.) to web dev (Django, Flask, etc.). Frankly, it is hard to compare Python to any other language from this point of view. Even Java (and Scala) cannot compete with it. Learning Python (NOT Scala) is by far the best use you can do of your time, nowadays.

AlessandroBottoni
Автор

You would need to use scala eventually if you are working with spark (i.e adding new data source or tweaking existing one).

_theman
Автор

great advice. When I started in spark, I started using Spark-Scala but now I will transition to Pyspark and you rightly said there are more libraries available in Python. Moreover most of the companies advertise their requirement for Pyspark

svdfxd
Автор

Python has huge libraries built ready. Don't ignore Scala. It is very niche in itself

harishgontu
Автор

Im getting into scala, apache with Hadoop lakes. Python is childs play but you can find more resources but nothing worth anything come easy.

skeetau
Автор

Many Scala developers may not like your opinion. But I and many more people I know have moved to PySpark. I am sorry but it is my personal opinion, Scala is good for something but Python is good for everything

vaibhavmaurya
Автор

Scala for sure, but you should use the right tool for the right job…

ReidMewborne