filmov
tv
Introduction to Kafka Stream Processing in Python using Faust
Показать описание
Faust is a stream processing library, porting the ideas from Kafka Streams to Python.
This video explains , how to use Kafka (very popular distributed messaging queue) and Faust ( a python based distributed stream processing library) to create a simple stream processing application.
Code:
--------
Start Zookeeper:
------------------------------
Start Broker:
------------------------------
Start Kafka Topic:
------------------------------
Install the required modules:
------------------------------
pip install faust-streaming
pip install kafka-python
Python Code:
------------------------------
import faust
app=faust.App('demo-streaming',broker='localhost:9092')
async def processor(stream):
async for message in stream:
print(f'Received {message}')
To run Fause Application
------------------------------
faust -A main worker -l info
Kafka Console Producer:
-------------------------------
Check this playlist for more Data Engineering related videos:
Apache Kafka form scratch
Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL
This video explains , how to use Kafka (very popular distributed messaging queue) and Faust ( a python based distributed stream processing library) to create a simple stream processing application.
Code:
--------
Start Zookeeper:
------------------------------
Start Broker:
------------------------------
Start Kafka Topic:
------------------------------
Install the required modules:
------------------------------
pip install faust-streaming
pip install kafka-python
Python Code:
------------------------------
import faust
app=faust.App('demo-streaming',broker='localhost:9092')
async def processor(stream):
async for message in stream:
print(f'Received {message}')
To run Fause Application
------------------------------
faust -A main worker -l info
Kafka Console Producer:
-------------------------------
Check this playlist for more Data Engineering related videos:
Apache Kafka form scratch
Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL
0:08:20
Apache Kafka 101: Kafka Streams (2023)
0:06:48
Apache Kafka in 6 minutes
0:11:43
Kafka Streams 101: Getting Started (2023)
0:10:12
1. Intro to Streams | Apache Kafka® Streams API
0:10:12
Introduction to Kafka Streams
0:13:12
Creating Kafka Streams Application | Kafka Stream Quick Start | Introduction to Kafka Streams API
0:02:35
Kafka in 100 Seconds
1:11:18
Introduction to Kafka Streams - Akash
0:04:03
Kafka Streams | Real-time Stream Processing using Kafka Streams API | Master Class Introduction
0:11:09
Introduction to Stream Processing in Kafka: Kafka Streams and KTables
0:15:51
What are Kafka Streams? | Kafka Streams API Tutorial | Hadoop Tutorial | Edureka
0:04:47
What is Kafka Streams?
0:23:44
Kafka Streams: Zero to Hero - Introduction
1:20:26
Introduction to Kafka Streams | Kafka Streams
0:41:33
Introducing Kafka Streams the New Stream Processing Library of Apache Kafka
0:03:23
Event Streaming in 3 Minutes
0:46:49
Introduction to Kafka Streams
0:19:45
Introduction to Kafka Stream Processing in Python using Faust
0:39:10
An introduction to Apache Kafka - this is Event Streaming, not just Messaging by Katherine Stanley
0:19:32
Kafka Stream Processing | Spring Boot
0:09:27
3. Transforming Data Pt. I | Apache Kafka® Streams API
0:14:50
Running your First Kafka Streams Application
0:37:21
Berlin Buzzwords 2016: Michael Noll - Introducing Kafka Streams, new stream processing library ...
0:31:11
ReactSphere: Probabilistic data structures for Kafka Streams by Mateusz Owczarek and Miron Ficak
Комментарии