Real-Time ETL

Full video available here:

Open-source streaming framework

Change Data Capture accelerates business insight and lightens the load on the database. This is especially true if data is being pulled from the write-ahead log vs. query-based methods.

Implementing it in real-time has historically been substantial work or substantial cost. Typically requiring Debezium/Kafka/ZooKeeper and expertise to manage these tools at scale. Or it would require using an expensive 3pd vendor.

#data #dataengineering #datapipeline