Kafka Topics, Partitions and Offsets Explained

Показать описание

Learn about Apache Kafka Topics, Partitions and Offsets and their meanings!
Get the Learn Apache Kafka for Beginners v3 course at a special price!

Don’t forget to subscribe to get more content about Apache Kafka and AWS!

I'm Stephane Maarek, a consultant and software developer, and I have a particular interest in everything related to Big Data, Cloud and API. I sat on the 2019 Program Committee organizing the Kafka Summit. I'm also an AWS Certified Solutions Architect, Developer, SysOps Administrator, and DevOps Engineer.

Follow me on social media:

Рекомендации по теме

Комментарии

That's a kind of a lecture people are usually dreaming of! I'm just getting started with Kafka and your lessons have made my day: thank you <3

megapixel

your videos are the best in explaining how kakfa works, clear and neat.

MrBdoleagle

Thanks a lot. I am thinking that I got the best Kafka materials.

satyaprakashparida

honestly this is much better than linuxacademy

aaandrade

Thanks a lot for these excellent lectures ❣

Gamer_with_knowledge

How make partition we need to create? How to calculate the proper number of it? What if I will have just 1 partition?

pawegrzesik

hi, great video. i'm trying to find a strategy to resolvé transaction for microservicios comunicated each others by Kafka. Do you think that is posible? thanks for your help.

aleman

Thank you. It was a really nice explanation.

ValmikKalathia

So as u said once it’s written at offset we can not update it that means the same data we can not update it?

roliagrawal

Where does kafka stores offsets of all partitions?

dhruvildoshi

When a consumer is to consume N records from Partition 0, 1, 2 of a topic, what does it mean? Is it reading N records from each partition? That would make it 3N records in total. Is it reading in round-robin fashion from partition 0, 1, 2, until the total read records is N?

yunlin

In your truck_gps example, you have created 10 partition and created truckId as a key. In this case the first 10 unique truck id will stored on each partition. what happen when we get the 11th truckId to which partition it will go?

padmanathanramasamy

how do I collect data from Kafka topic as batches and then use poll to send data to Redshift in intervals of time

sushmakl

How to fetch offset for particular events in the consumer??

meghanapulavarthy

can some one who is good in PPTs explain how those Message boxes are designed in power point?

Pavan-MGM-IT-Training

Kafka Topics, Partitions and Offsets Explained

Topics, Partitions and Offsets: Apache Kafka Tutorial #2

Kafka Topics, Partitions and Offsets Explained

Apache Kafka 101: Partitioning (2023)

How do Topics, Partitions and Offsets work in Apache Kafka?

Kafka Topics and Partitions

Topics, partitions, and offsets in Kafka

Kafka Pro Tips | Mastering Message Routing with Specific Partitions | @Javatechie

Apache Kafka in 6 minutes

Apache Kafka - Kafka Topics, Partitions, Messages, And Offsets

Apache Kafka 101: Consumers (2023)

What is topic, partition and offset in Kafka?

Kafka Offsets Committed vs Current vs Earliest vs Latest Differences | Kafka Interview Questions

2.APACHE KAFKA : What is Offset in Apache Kafka ||Kafka Tutorial || APACHE KAFKA||TOPIC || OFFSET

Read Kafka Messages from a Specific Offset & Partition in the Console Consumer | Kafka Tutorials

Kafka Series | Kafka Topic | Partitions | Offsets

Apache Kafka 101: Partitioning (Hands On - 2023)

Apache Kafka Architecture | Learn Kafka Core Concepts | Kafka Training Course for Beginners

Kafka Consumer Offsets Explained

Debug Kafka Consumers: Partitions & Offsets

Part 6 - What is Kafka topic partition | Kafka for beginners

Apache Kafka® Architecture: Overview of Kafka's Internal Components

Kafka topics partitions replication

Kafka Tips (Topics ,Partitions, Offsets etc) Part I

What is Kafka Topic Partitions? | Apache Kafka Tutorial | Kafka Tutorial for Beginners