What Is Apache Spark?

Do you have a big data problem? Too much data to process or queries that are too costly to run in a reasonable amount of time? Spare your wallet and stress levels! David Adeyemi introduces Apache Spark. It may save you a hardware upgrade or testing your patience waiting for a SQL query to finish.

[farmanpirzada]

That was one of the most unnecessary interruptions I've ever seen, y'all can just mention to subscribe in a banner or something.

[NayanKabir-nqpo]

Bro why did that other guy even interrupt, I'm here to see more of the presenter. He's amazing and seems real smart

[pemessh]

Hats off for such a great start. really loved how you addressed the problem and then moved on.

[romulodrumond]

Great intro! I would be interested in big compute showdown comparing multiple tools for distributed machine learning training and inference (Hadoop vs spark vs dask vs ray vs...)

[bald_goat]

Nice intro! I wish IBM team dived deeper into Apache Spark and created a playlist with sequential tutorials.

[jackieparzival]

Spark is so much more, and this is a great intro... just hope it would've touched some of the amazing features so people would be more interested in dive deeper

[saboorahamd]

Always love the IBM knowledge videos. But, maybe don't jump in the video like that for requesting subscription. It took a few seconds to get that out of mind before getting back to the topic. Cheers!

[subramanyamysore]

When you are working with Kafka/KStreams, are you suggesting that we move into Apache Spark ONLY when the computation/data is large?

[Rebellionrider]

This is a quick introduction for those who have no idea what spark is? Good take

[dadoll]

Amazing, I'm currently taking IBM Data Engineering Professional Cert, more on this topic please!!!!

[EdwardQuixote]

This is brilliant! The other guy interrupting came as a surprise - cut that off! But this is amazing! Literally understood what Apache Spark is from a 2-minute video! Thanks.

[csmoothnj]

Dope, informative and concise video!

I did not need dude coming in from the right though 😅

[JoseAguilar-yzbq]

There's no way he just wrote Apache Spark from behind the glass-board without even hesitating, respect.

[trinhnguyen-lvkm]

I installed Python, Spark, Hadoop, I can run pyspark in command prompt but when i try to run in VS code, the following error appear: PySparkRuntimeError: [JAVA_GATEWAY_EXITED] Java gateway process exited before sending its port number.

Pls help me to fix that, I google so much time but nothing change. PLS Pls

[bloom]

What a start! amazing explanation of what is spark starting with problem definition. But that interruption by other guy was not a good idea.

[cloned]

honestly it's pretty fascinating how such a seemingly innocuous script decision—a reminder to 'like and subscribe'—elicited such a strong negative response from viewers. really underscores the crucial interplay between intention and execution, because in practice, it really did come off as a rude interruption.

[wpouser]

Great video, just the interruption from the other dude that leave a bad taste to a overall very good video.

[kenlam]

How did he write the notes in reverse for us to read?

[lilbean_eth]

this reminds me of the white board sessions we had at UCSD

[medami]

But wouldn't the kubernetes use the machine ressources as well? How is that going to help bypassing your machine limits?