Stream Processing 101 | Basics

preview_player
Показать описание
Real-time processing of data using stream processors has become a fundamental part of any system design. Let’s discuss some of the use cases and complexities related to stream processing.

We will also talk about Lambda architecture which is a system composed of both batch processing and stream processing.

🥹 If you found this helpful, follow me online here:

0:00 Unbounded Data
00:56 What is Streaming?
04:38 Real-Life Examples
06:25 Lambda Architecture (Batch + Stream?)
10:04 Outro

#kafka #streamProcessing #flink #systemDesign #programming #softwareDevelopment
  1. Code with Irtiza
  2. kafka
  3. stream processing
  4. flink
  5. system design
  6. programming
Рекомендации по теме
Stream Processing 101 0:10:17

Stream Processing 101 | Basics

Stream Processing 101 0:14:51

Stream Processing 101 - An Introduction

Intro to Stream 0:07:50

Intro to Stream Processing with Apache Flink | Apache Flink 101

Learn How Stream 0:31:30

Learn How Stream Processing Works The Simplest Way Possible

Apache Kafka 101: 0:08:20

Apache Kafka 101: Kafka Streams (2023)

Kafka in 100 0:02:35

Kafka in 100 Seconds

Kafka Streams 101: 0:11:43

Kafka Streams 101: Getting Started (2023)

Stream Processing System 0:11:24

Stream Processing System Design Architecture

Batch Processing vs 0:13:37

Batch Processing vs Stream Processing | System Design Primer | Tech Primers

Stream vs Batch 0:09:02

Stream vs Batch processing explained with examples

Processing The 'Beginning' 0:00:34

Processing The 'Beginning' of the Stream

Apache Kafka in 0:06:48

Apache Kafka in 6 minutes

Kafka Streams 101: 0:05:31

Kafka Streams 101: Basic Operations (2023)

Event Streaming in 0:03:23

Event Streaming in 3 Minutes

How Video Streaming 0:05:24

How Video Streaming works | System Design

What is Stream 0:06:20

What is Stream Processing? | Batch vs Stream Processing | Data Pipelines | Real-Time Data Processing

What is Data 0:01:33

What is Data Streaming?

Nvidia CUDA in 0:03:13

Nvidia CUDA in 100 Seconds

Atlas Stream Processing 0:02:31

Atlas Stream Processing Explained in 3 minutes

Batching VS Streaming 0:00:49

Batching VS Streaming Data Explained

Apache Flink 101 1:04:42

Apache Flink 101 | Building and Running Streaming Applications

Real-Time Stream Processing 0:35:32

Real-Time Stream Processing with Kafka Streams ft. Bill Bejeck

Stream Processing Explained 0:04:55

Stream Processing Explained

How to Build 0:06:38

How to Build a Stream Processing System | Data Streaming Systems

Комментарии
Автор

absolutely fantastic man ! all of your videos are easy to understand and helpful. Thanks dude

eskici
Автор

Fantastic man !! I lately found ur channel, content regarding system design is top notch and precise to the point !!
Could you add these below things into ur video, Example what are the popular frameworks are being used for particular kind of jobs, Ex Starem processing, So what programming language will be the exact match, with this details it really fills the missing link in this valuable content.

Your kafka demo video is super helpful, because you have shown the glimpse of implementation, pls do these kind of tuts it really helps, Thanks a ton brother !!

bjugdbjk
Автор

thanks sir for such simple yet comprehensive content, however if one is intrested adding a bit of streaming compononent to a simple webapp like those being built with solara /fast api in python , or shiny-based apps in R ? what is the best way going about that ? let say I want to let my function behind the app calculate / estimate certain relationship but based off real-time data (usually it comes with delay) like those being featured on nasa weather conditions or yahoo or on-line IoT data sources or simple news articles on FT? while not consuming minimum of memory possible !
I appreciate if you can provide some form of written / video-based content of how to at least go about that on conceptual / design level ?
your input is highly appreciated

mikiallen