Why You Need To Learn Apache Spark and Kafka | Tutorial #1

In this tutorial I show you why companies love Apache Spark and Apache Kafka: Distributed Processing. It's also exactly the reason you you need to learn both. Because companies build their data science platforms on them.

►Learn Data Engineering with my Data Engineering Academy:

#datascience #dataengineer #plumbersofdatascience

[ukelaalred]

Thank you! All of your videos are amazing!

[standjustice]

Thank you for the informative content!

[kyoono]

I saw this needed for a job, I think ill keep bagin groceries

[Kostasd]

Great video Andreas. Nice ideas on how to use these technologies to build a project.

[samuelbrown]

Very good intro into Kafka. I am beginning to learn it and I have found this video very useful.

[Karmihir]

Hi I'm one of your subscriber,
I'm switching my career from Oracle DB developer to Big Data(Hadoop/Spark) please share more videos.

[paulntalo]

Thanks so much for the video. Am new spring5 but my intention is for data science career. am surprised you didn't talk about R or Python here. So am I right assume I can build a great career in big data analytics with Java without having to learn Python. In my journey I don't want to branch out into learning Python. With that view can I make a good data scientist.

[MrFreezy]

Kafka now can do some of the task for spark. Like ksql and also helps in validating the data.
Can you make videos on that ?

[gowrishm]

really thanks for your help and patience...and thats a great video...

[svdfxd]

Awesome. Why did it take me so long to find this channel?

[zramzscinece_tech]

Has Spark any future as BigQuery/Snowflake other cloud based tools are providing nearly all options what Spark can do?

[abdullahsiddique]

How stable do u think would be a career in Apache spark and what is the learning route for this ?

[mikho]

thank you for the video, i just didnt catch where you said its good place to practice was it spark subline??

[alen]

in the first step ingestion- you mentioned the API call running on top of multiple servers- so this specific step is batch processing to gather the data ? instead of real time?
can you please shed some light on this step?

[marvinsosa]

Thank for this video! It is cool, why dont use kafka stream or another tool like this ? I guess this is by I would use Scala languaje

[sarjeetkumar]

Hi I'm your new subscriber, thanks for this great video.

[codeforsteamchannel]

how i learn these dunno how to start too much points

[rajath]

I think you should've talked about mapreduce too... I mean given as gist of comparison.

[abhishek-shrm]

Great Video, Sir. Can you please tell me how much knowledge of data engineering is required for a data scientist? I have heard that on a company level in data science, you cannot train your model on local systems. You have to use spark and other tools for working with large and big datasets. So how much should I learn about data engineering tools and technologies?

[subhaniguddu]

with in ....0.15 sec i have subscribed ..plz do more videos