What is Data Pipeline? | Why Is It So Popular?

Animation tools: Adobe Illustrator and After Effects.

Checkout our bestselling System Design Interview books:

ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

[petenjs]

3:13 typo *AWS Glue.
Love these vids, thanks!

[SudhanvaDixit]

0:49 Shouldn't the last one be 'Consume'?

[mrseanpaul]

I love the short video format, as I can dive deeper on topics and terms I am interested in on my own time :)

[ttehir]

Why do we mostly talk about data pipelines for BI or ML when many times we also need it for functional applications?

[prasenjeetrathore]

Amazing explanation, so far the most easy to digest video about data pipelines.

[gus]

💯 Looking like your channel is on track for 1 million subscribers by year end! Great stuff! 😎✌️

[atomtamadas]

Spark is widely used in stream processing too, not only batch, see spark structured streaming.

[ChrisPatt]

Loved how simply you explained this complicated concept! Also what are your thoughts on Irys, world's only provenance layer ensuring the data integrity and accountability.

[vlplbl]

Great video. Small remark: the AWS service for ETL is called AWS Glue, not Glow

[husseineldeeb]

Amazing video. Thanks for your great efforts!

[aamirsuleman]

I think you meant AWS Glue 3:18. Appreciate these informative videos

[kartikmahajan]

this was very useful. thanks for sharing.

[footballnasoccer]

I like your presentations. What do you use to make them?

[mwanthidaniel]

Which tool do you use to create these animated presentations?

[data_junkie]

What do you use to create these animations/info graphics

[bladethirst]

Maybe some examples of simplified pipeline on specific application would make this video even better.

[chrisc]

Fantastic video and graphics, what program do you use to animate your graphics? It's great stuff.

[Paul__xar]

Important information about refunds: what a joy

[chrisalmighty]

Video illustrations look neat. What tool did you use create the presentation illustrations?

[markwallstrom]

No mention of Apache Iceberg and such technology?