Apache Kafka tutorial: 0.8.2 and Beyond - Jay Kreps

preview_player
Показать описание

Apache Kafka committer, Jay Kreps from LinkedIn, walks through a brief production timeline for Kafka. Jay goes over what's new with 0.8.2 and how to get the most out of new features like Log Compaction and the new Java producer. Jay also gives an overview what to expect from 0.9(?): a new consumer, better security and operational improvements.

This talk was given at the Apache Kafka NYC meetup at Tapad.

ABOUT DATA COUNCIL:

FOLLOW DATA COUNCIL:
Рекомендации по теме
Комментарии
Автор

the new java producer is actually blocking on send operation if the broker is down, reason is that while trying to retrieve the metadata is doing on the main thread. Because it fails to connect it enters into an infinite loop where it retries to reconnect. I had to wrap it into a scala future and if there is a timeout I will close the producer. Is important for me to be notified if the broker is not available to implement back pressure mechanism from my producer and the new Kafka producer was not ideal for me.

patrickdiloreto