Real-time ingested historical feature store with Iceberg, Feast and Yummy

preview_player
Показать описание
In this video I will show how to use Apache Iceberg as a store for historical feature store.
Moreover we will build end to end real-time ingestion example with:
* Postgres
* Kafka connect
* Iceberg on Minio
* Feast with Yummy extension

In the video I will show:
1. What is an Apache Iceberg ? And why is it a good idea to use it as a store for historical features ?
2. How to ingest Iceberg on Minio in the real-time from multiple data sources like Postgres database ?
3. How to use Iceberg with Feast with Yummy extension ?

The real-time kafka connect integration and Iceberg sink usage is based on the article:

The whole example is available on:

And the detailed description is here:

#feast #iceberg #mlops #spark #kafka
Рекомендации по теме