Building Streaming Analytics App from RDBMS to dashboard with Kafka - Björn Rost, Pythian (English)

#ApacheKafkaTLV - Meetup#5 - 24.01.2018 - Part 2
Apache Kafka is a massively scalable message queue that is being used at more and more places connecting more and more data sources. This presentation will introduce Kafka from the perspective of a mere mortal DBA and share the experience of (and challenges with) getting events from the database to Kafka using Kafka connect including poor-man’s CDC using flashback query and traditional logical replication tools. To demonstrate how and why this is a good idea, we will build an end-to-end data processing pipeline. We will discuss how to turn changes in database state into events and stream them into Apache Kafka. We will explore the basic concepts of streaming transformations using windows and KSQL before ingesting the transformed stream in a dashboard application.
Björn Rost is an Oracle Developer Champion, ACE Director, and one of Pythian’s top Oracle experts. A popular presenter, Björn travels the world attending technology conferences, sharing insights, and learning with his wide network of peers. Björn is attending ILOUG Tech Days 2018 in Israel.