What is the Difference Between Spark & Hadoop

preview_player
Показать описание
► DATA ENGINEER RESOURCE - Site devoted to "BUILDING STRONGER DATA ENGINEERS" ◄

► ASK BIG DATA BIG QUESTION - Submit questions to be answered on Big Data Big Questions ◄

► BIG DATA BEARD PODCAST - Subscribe to learn what's going on in the Big Data Community ◄


Today's episode of Big Data Big Questions tackles the differences between Hadoop and Spark. Which is better Hadoop vs. Spark. Hadoop has been around for a long time but it seems to be more and more developers are migrating to Spark. What does this mean for Hadoop?

Learn the differences between Spark and Hadoop in this episode of Big Data Big Questions.

► CONNECT ON TWITTER ◄

Рекомендации по теме
Комментарии
Автор

The main problem with Hadoop is that it is not optimized to handle iterative data processing. The HDFS system becomes overburden with constant assesses as the output of reduce becomes input to Map over and over until the final convergences takes place. Also, the data processing is Acyclic and you cannot interact with each stage of processing. Even though you can do iterative processing on Hadoop it is not very efficient; Hence Spark !!

onuberonly
Автор

Should I learn Hadoop now or can directly go to spark?

mrchatterjee_
Автор

Could you make a video on which certification is recommended for spark?

nikhildavis
Автор

i think for machine learning spark is best what's your view on this?

neuron
Автор

with all those cloud vendors offering large storage, is hadoop for organizations dying??

SuperBhavanishankar
Автор

@Thomas Henson. Please considering testing out some smart sound or smart volume software. I am having to chase your speaking volume.. One second it is too loud and will annoy the neighbors or even me. And the next minute I am backing up the video to hear what I missed. Sorry to be a complainer but I love your videos. You seem friendly and your information is thorough and easy to understand. (If I can hear it.) ;)

brianmoote
Автор

with all those cloud vendors offering large storage, is hadoop for organizations dying?

MercedeX
Автор

Hadoop is just 2 components? well, what about yarn?

naheliegend