7.4 Complete Kafka Training - How to delete a Kafka Topic

Показать описание

This comprehensive Kafka tutorial focuses on with building foundation about all major concepts in Apache Kafka. This part of the course is important to understand how Kafka really works and it will help you with hands-on exercises later in this course.

In the later part of this Kafka tutorial, we will have lots of hands-on exercises covering from basic to advanced topics of Kafka. You will learn how to set up Apache Kafka on your personal computer (Mac/Linux or Windows PC). Then create Kafka topics (where actual data is stored inside Kafka) & perform various operations on your topics. Later you will setup Kafka producers and Kafka consumers to send and receive data.

In more advance topics you will learn how to create your own Kafka Producers and Kafka Consumers.

Why Apache Kafka
Apache Kafka is an open source distributed streaming platform which can handle 100s of billions of events in a day. Originally Kafka was built to replace legacy messaging systems with a reliable, fast and distributed streaming platform.

Apache Kafka was built and open sourced by LinkedIn in 2011. Today it has become the most sort after data streaming platform in the world. It is a tough competitor to Apache Spark Streaming engine.

Like Hadoop is a distributed storage and distributed processing platform & spark is a distributed in-memory processing engine, Apache Kafka is a distributed data streaming platform.

All these 3 systems complement each other. If you know Hadoop and Spark systems then Kafka is the missing link for connecting the dots.

You will learn
Section 1 – APACHE KAFKA & IT’S FEATURES
In this section of the course, we will start with building the knowledge about various key concepts of Apache Kafka. This will be important section, so make sure you watch all videos before moving to the next section of the course. Here are some of the chapters covered in this section:

What is Apache Kafka?
How Apache Kafka provides High Level of Scalability?
Kafka’s In-built Fault Tolerance
Apache Kafka is damn Popular
Section 2 – WHY APACHE KAFKA?
In this part of the course, we will discuss why we really need Apache Kafka and what kind of real world problem does it solve? Here are some of the chapters covered in this section:

Why we need Apache Kafka?
Decoupling of Systems
Section 3 – APACHE KAFKA ARCHITECTURE
It’s time to dig deeper into how Apache Kafka really works and we will do this by understanding Kafka’s architecture.

Apache Kafka Architecture
How Netflix is using Kafka
Section 4 – ANATOMY OF APACHE KAFKA
In this section of the course, we will look at various components that make Apache Kafka what it is today. This is an important section of this course. It will help you really build the core understanding about each individual component of a Kafka application.

What is Kafka Broker
Kafka Topic Explained
Learn about Kafka Topic Partitions
What are Kafka Offsets
How Replication Works in Kafka
Who is the leader
Let’s talk about Zookeeper
Kafka Producers
Kafka Consumers
Putting everything together
Section 5 – DESIGNING APACHE KAFKA APPLICATIONS
In this section, we will talk about what to consider while designing Apache Kafka applications.

Designing Considerations
Section 6 – EXPERT LEVEL HANDS-ON
Let’s use the knowledge and get our hands dirty by working on some real exercises.

Setup Apache Kafka on Local Computer (Mac & Linux users)
Setup Apache Kafka on Local Computer (Windows PC users)
How to connect to HDP Sandbox terminal (Windows PC users)
Let’s fire up a local cluster (Windows PC users)
It’s time to create some Kafka Topics
What Kafka topics you got?
Peak inside a Kafka topic
How to delete a Kafka topic
Running a Kafka Producer
Running a Kafka Consumer
What to do when a Kafka Producer or Kafka Consumer goes down in production
Section 7 – ADVANCE LEVEL HANDS-ON
In this part of the course, you will work on more advanced subjects.

How to create your own Kafka Producer (Java Code)
How to create your own Kafka Consumer (Java Code)
Integrating Kafka with Spark Streaming (Scala Code)
Running your Spark Data aggregator
Section 8 – BONUS LECTURES
Trick #1 – Generate data for your Kafka Console Producer
Trick #2 – Simulate a Real Time Streaming Data Source

Find us on: