Kafka Tutorial - Consumer Groups

Spark Programming and Azure Databricks ILT Master Class by Prashant Kumar Pandey - Fill out the google form for Course inquiry.
-------------------------------------------------------------------
Data Engineering using is one of the highest-paid jobs of today.
It is going to remain in the top IT skills forever.

Are you in database development, data warehousing, ETL tools, data analysis, SQL, PL/QL development?
I have a well-crafted success path for you.
I will help you get prepared for the data engineer and solution architect role depending on your profile and experience.
We created a course that takes you deep into core data engineering technology and masters it.

If you are a working professional:
1. Aspiring to become a data engineer.
2. Change your career to data engineering.
3. Grow your data engineering career.
4. Get Databricks Spark Certification.
5. Crack the Spark Data Engineering interviews.

ScholarNest is offering a one-stop integrated Learning Path.
The course is open for registration.

The course delivers an example-driven approach and project-based learning.
You will be practicing the skills using MCQ, Coding Exercises, and Capstone Projects.
The course comes with the following integrated services.
1. Technical support and Doubt Clarification
2. Live Project Discussion
3. Resume Building
4. Interview Preparation
5. Mock Interviews

Course Duration: 6 Months
Course Prerequisite: Programming and SQL Knowledge
Target Audience: Working Professionals
Batch start: Registration Started
Fill out the below form for more details and course inquiries.

--------------------------------------------------------------------------
Best place to learn Data engineering, Bigdata, Apache Spark, Databricks, Apache Kafka, Confluent Cloud, AWS Cloud Computing, Azure Cloud, Google Cloud - Self-paced, Instructor-led, Certification courses, and practice tests.
========================================================

SPARK COURSES
-----------------------------

KAFKA COURSES
--------------------------------

AWS CLOUD
------------------------

PYTHON
------------------

========================================
We are also available on the Udemy Platform
Check out the below link for our Courses on Udemy

=======================================
You can also find us on Oreilly Learning

=========================================
Follow us on Social Media

========================================

[ScholarNest]

Want to learn more Big Data Technology courses. You can get lifetime access to our courses on the Udemy platform. Visit the below link for Discounts and Coupon Code.

[tochinwa]

You're a natural born teacher.
Thanks.

[mohammedmohideen]

The summary in this video explains how beautiful this learning is structured. Great Work, Thx much sir!!

[bharatrbk]

FOR A CORRECTION, at 5:50 minutes, it is not First Coordinator it actually first consumer who joins the group called as LEADER and the rest Members/Followers.

[itsmepakky]

most simplest way of explanation. love it.

[nikolozrb]

the best explanation of how groups work

[nailsafiullov]

I’m afraid there was an occasional mistake in the part 16 “Consumer group” at 5:54. There was told that the first coordinator to participate in a group becomes a leader but in fact it was meant to be that the first consumer becomes a group leader.

[dipuroy]

a very very good tutorial ! Like that presentation (Y) !

[parkerhao]

Awesome tutorial series! I'm wondering if there's a python version for the codebase or any resources that I can look up? Also what are some major differences between confluence kafka & kafka?

[bsrameshonline]

Very good explanation on consumer groups architecture

[MohammedKhan-hpsj]

I'am very much pleased with the way and ease you explain things, thanks a loot for that, how ever i've a question could you please help me with it ?
Q)What if the group leader crashes or wants to exit the group, which member will be picked to become leader and who makes it leader ?

[abbi]

Thanks. It's really good. Could you please also explain how do multiple messages get sent with multiple producers using one java program ? All these programs run with a single thread. Do we need to use threads or run multiple java programs run the same code, which send different messages ? or the same program you've written works and set a config on producer api.

[ramana]

Awesome tutorials, is there any videos for kafka security ? i mean SASL_SSL or SSL with authenetication and authorization,

[silverfish]

Great material. Thanks sir. is it possible we could have access to slides of the whole series so that if we want to refer to something in future we dont have to view the whole video again?
Thanks again.

[shubhammahindru]

Great lecture and content very well explained.

[jorgeacetozi]

This lecture was about dealing with multiples consumers within the same consumer group and same instance application running on a single machine. But what would change from that if I wanted to configure multiple consumers in the same consumer group but running in different machines for achieving greater horizontal scalability?
Thanks for your lectures, you've done such an awesome job!

[MohammadRasoolShaik]

Could you please provide, slideshow you are presenting in videos. It would be very helping to refer in future.

[robind]

Came back to review your video again, learned more each time. May I have a question here,
I am using kafka-mongodb-sink connection to pass data from 3 kafka brokers to A mongodb in my system. I am planing to parallel insert to mongodb. so on each host I have broker + connector + mongodb primary shard.
My question here is the connector should be in distributed mode or standalone mode? as now I use the distributed mode. hope this is correct setup.
thanks, your demo is very advanced and very clear.
Robin

[HarishSharma-trik]

Please can you suggest how can we create multiple consumer in same application for parall read

[ramasubbareddy]

1) I have a question here, When we say the replication factor 3 then the same message will be there in different partitions right, In this case is there any chance that the consumer can read same message from different partitions ?
2) Is there any chance that group leader can be overloaded during re-balance action executing