Machine Learning with Apache Kafka without another Data Lake

preview_player
Показать описание
Streaming Analytics for IoT Data with Apache Kafka and Machine Learning - without the need for another data lake like Hadoop or Spark.

Tiered Storage in Kafka and other capabilities establish a simplified big data architecture without the need for another data lake. Implement new consumer applications, error-handling, compliance / regulatory processing, query and analyze existing events, model training with an event streaming platform as the central nervous system.

More resources:

  1. Kai Waehner
Рекомендации по теме
Apache Kafka in 0:06:48

Apache Kafka in 6 minutes

Streaming Machine Learning 0:34:15

Streaming Machine Learning with Apache Kafka and TensorFlow

machine learning with 0:01:58

machine learning with Kafka events

Apache Kafka and 0:44:17

Apache Kafka and Machine Learning in Pharma and Life Sciences

Machine Learning with 0:21:04

Machine Learning with Apache Kafka without another Data Lake

Kafka in 100 0:02:35

Kafka in 100 Seconds

Real-time Threat Detection 0:29:19

Real-time Threat Detection Using Machine Learning and Apache Kafka

Deep Learning with 0:11:25

Deep Learning with the Apache Kafka® Ecosystem

Apache Kafka (4 0:44:11

Apache Kafka (4 Weekends Batch) tutorials || by Mr. Vishwa On 09-11-2024 @11:30AM

Kafka’s Streams API 0:42:45

Kafka’s Streams API for Highly Scalable Machine Learning & Deep Learning in Real Time by Kai Wae...

Streaming Machine Learning 0:39:16

Streaming Machine Learning with Apache Kafka and without another Data Lake by Kai Waehner

Implementing Enterprise Apache 0:43:45

Implementing Enterprise Apache Kafka platform to enable Machine Learning | Beyond Prediction Series

Machine Learning & 0:18:58

Machine Learning & Apache Kafka - the next generation of intell. software | Big-Data.AI Summit 2...

Apache Kafka and 0:59:50

Apache Kafka and Machine Learning in Banking and Finance Industry

Streaming Machine Learning 0:36:29

Streaming Machine Learning with Apache Kafka and TensorFlow (without a Data Lake)

Streaming Analytics with 0:21:10

Streaming Analytics with Apache Kafka and Machine Learning – Kai Waehner, Confluent

Kafka Basics #javascript 0:00:58

Kafka Basics #javascript #python #web #coding #programming

📈 Stock Market 1:04:00

📈 Stock Market Real-Time Data Analysis Using Kafka | End-To-End Data Engineering Project

Apache Kafka in 0:54:13

Apache Kafka in the Automotive Industry

Real-Time Machine Learning, 0:05:23

Real-Time Machine Learning, predictions and optimization with Apache Kafka running in Google Cloud.

MLOps #34: Streaming 0:52:50

MLOps #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

DataXDay - How 0:40:01

DataXDay - How to leverage the Apache Kafka Ecosystem to productionize Machine Learning

Scalable End to 0:11:17

Scalable End to End Machine Learning Data Pipeline with Kafka Streaming

System Design: Why 0:04:20

System Design: Why is Kafka so Popular?

Комментарии
Автор

Hi i just noticed you have just a few views... supreme presentation!

machinelearning
Автор

Hi Kai, good overview. One note: nowadays models are not just tensors (matrix of coefficients) or object code. They often come as Python code (as data-scientists use it). My question: what architectures / tools you recommend for production Kafka-based pipelines processing for real-time predictions, e.g. when it is required to execute multiple models (concurrently and/or sequentially) and make data transformations tasks among these steps? Thank you.

nikolayilyin