Real-Time Kafka & Spark Streaming Project Demo (Beginner Friendly)

Показать описание

🚀 Join me in this in-depth demonstration where I delve into the world of real-time data streaming! In this video, I take you through a life-like example of a streaming application, utilizing the power of Apache Kafka and Spark Streaming.

🌐 About this Video:
We'll explore a practical scenario where a financial company launches an instant cashback campaign. This campaign is unique – it offers immediate rewards when a customer's transaction meets specific criteria.

🔍 What You'll Learn:

Kafka in Action: Understand how Kafka efficiently handles transaction data in real time.
Spark Streaming Simplified: See how Spark Streaming processes and analyzes data on-the-fly.
Criteria-Based Cashback: Discover the logic behind triggering instant cashbacks based on transaction criteria.

📈 Enhance Your Skills:
Learn how to implement real-time data processing for financial transactions, a skill highly relevant in today's data-driven world.

🔔 Don't forget to Subscribe!
Stay updated with my latest tutorials and demos on data streaming technologies and more.

📣 Share Your Thoughts:
I love hearing from you! Drop your questions, feedback, or ideas in the comments below.

📚 Resources and Further Reading:
All resources in this video can be found below

👍 Like, Share, and Subscribe for more tech demos and tutorials!

Рекомендации по теме

Комментарии

Thank you very much. Please do more end-to-end data pipeline project demos.

JeffersonG-re

very good video, gives a good ideia about an use cases of kafka.

DeyvidCabral

please what is the version of kafka you have used ?

zakariaelaaliji

Hi, no show registers in the consumer

roberthuaytacortez

How do you change localhost:9092 to kafka:9092??

XELTRA

hello. this is a greate content. However when I reproduce I encounter this bug
When I click on and auth jupyter notebook in docker, I not seeing any notebook file, it is empty
If I manual upload the code file, when I run it will have error : Failed to find data source: kafka. Please deploy the application as per the deployment section of "Structured Streaming + Kafka Integration Guide".;

The code is exec.ipynb from your drive folder. Please help me if can, I am very appreciate

hoanghaang

Real-Time Kafka & Spark Streaming Project Demo (Beginner Friendly)

Real-Time Kafka & Spark Streaming Project Demo (Beginner Friendly)

Building Realtime Data Pipelines with Kafka Connect and Spark Streaming

Building Realtime Data Pipelines with Kafka Connect and Spark Streaming

Apache Spark Real time Stream processing | Learn Spark Kafka Integration for Stream Processing

Integrating Spark Streaming with Apache Kafka

Kafka in 100 Seconds

Real-time Analytics with Apache Kafka and Spark Streaming

10 Spark Streaming Read from Kafka | Real time streaming from Kafka

Realtime Data Streaming | End To End Data Engineering Project

Real-Time Big Data Streaming with Kafka and Spark

Real-Time Data Streaming, Processing with Kafka, Spark & Debezium : Event-Driven Architecture

Real-Time Twitter Data Ingestion With Kafka & Spark

Kafka Streams | Real-time Stream Processing using Kafka Streams API | Master Class Introduction

Realtime Risk Management Using Kafka, Python, and Spark Streaming

Apache Kafka with Spark Streaming | Kafka Spark Streaming Examples | Kafka Training | Edureka

Kafka Spark Streaming | Kafka Spark Streaming Example | Spark Training | Kafka Training |Intellipaat

Nick Evans: Realtime Risk Management Using Kafka, Python, and Spark Streaming

Realtime Socket Streaming with Apache Spark | End to End Data Engineering Project

Spark Kafka Cassandra | End to End Streaming Project

Building Realtime Data Pipelines with Kafka Connect & Spark Streaming by Ewen Cheslack-Postava

📈 Stock Market Real-Time Data Analysis Using Kafka | End-To-End Data Engineering Project

Spark Streaming using Scala | Learn Spark Kafka Stream Processing in Scala

Distributed systems for stream processing: Apache Kafka and Spark Streaming / O'Reilly Velocity

Apache Kafka in 6 minutes