Using Kafka with Flink | Apache Flink 101

preview_player
Показать описание

Flink has first-class support for developing applications that use Kafka. This video includes a quick introduction to Kafka, and shows how Kafka can be used with Flink SQL.

--
ABOUT CONFLUENT

#flink #kafka #streamprocessing #confluent
  1. Confluent
  2. confluent
  3. kafka
  4. flink
  5. apache flink
  6. apache kafka
Рекомендации по теме
Using Kafka with 0:03:50

Using Kafka with Flink | Apache Flink 101

Apache Kafka Vs. 0:12:22

Apache Kafka Vs. Apache Flink

Consume Apache Kafka 0:08:34

Consume Apache Kafka Messages using Apache Flink and Java

How to start 0:02:45

How to start learning Apache Kafka and Flink!

Building a Real-Time 1:25:00

Building a Real-Time Data Streaming Pipeline using Apache Kafka, Flink and Postgres

What is Apache 0:09:43

What is Apache Flink®?

Apache Kafka and 0:16:56

Apache Kafka and Flink: Stateful Streaming Data Pipelines made easy with SQL

Building a Real-Time 1:00:53

Building a Real-Time Data Streaming Pipeline using Kafka, Flink and Postgres | Stream 100K records

Processing Kafka Sources 0:26:06

Processing Kafka Sources and Sinks with Apache Flink in Python

Realtime Streaming with 2:26:01

Realtime Streaming with Apache Flink | End to End Data Engineering Project

Flink vs Kafka 0:55:56

Flink vs Kafka Streams/ksqlDB: Comparing Stream Processing Tools

Produce Apache Kafka 0:10:55

Produce Apache Kafka Messages using Apache Flink and Java

Apache Kafka in 0:06:48

Apache Kafka in 6 minutes

Realtime Analytics Using 1:13:13

Realtime Analytics Using Kafka & Flink

Apache Flink - 0:10:57

Apache Flink - A Must-Have For Your Streams | Systems Design Interview 0 to 1 With Ex-Google SWE

Kafka in 100 0:02:35

Kafka in 100 Seconds

Apache Flink and 0:03:39

Apache Flink and Apache Kafka Setup

How to access 0:08:50

How to access data in Apache Kafka using Apache Flink

[English] Stream data 0:29:53

[English] Stream data processing platform using Apache Kafka and Flink SQL on k8s

GenAI Demo with 0:16:33

GenAI Demo with Apache Kafka, Flink, LangChain, OpenAI

Integrating Flink and 0:18:40

Integrating Flink and Kafka in the standard genomics pipeline - Francesco Versaci

The different Streams 0:03:01

The different Streams Processing

AI-powered Recommendation Engine 0:09:06

AI-powered Recommendation Engine with Kafka and Flink for Current23

Apache Flink For 0:58:06

Apache Flink For Analytics | End to End Data Engineering Project

Комментарии
Автор

There seems to be a lot of parallelism between Flink and Kafka. They seem to operate over the same concepts. Even the API layers (processor, DSL, streams) are identical. What can one do with Flink that would not be doable with Kafka alone ? Why would you insert a Flink based process between two Kafka topics ? Wouldn't the Kafka processor/streams/DSL api be sufficient to handle the necessary transformation between the two topics ?

CristianMihaila-js
Автор

In the Kafka architecture section, you mentioned that the Producer is KafkaSink and the COnsumer is KafkaSource, is that correct?

JaymeeJane
Автор

Is flink similar to Apache Airflow, except Flink works with streams

rajeshacharya