filmov
tv
Flink in Containerland - Patrick Lucas (data Artisans)
Показать описание
Flink Forward Berlin, September 2017 #flinkforward
Patrick Lucas, Senior Data Engineer at data Artisans
Apache Flink, a powerful distributed stateful stream processing framework, is an especially good fit for deployment on a containerization platform: its storage requirement is primarily external (e.g. HDFS or S3), clusters often share the lifetime of the jobs that run on them, and the flexibility of allocating resources on such a platform allows for scaling jobs up and down as necessary. In this talk I will give a brief introduction to Apache Flink, then describe the journey to making it a first-class citizen of the container world. I will cover my experience preparing to publish the “official repository” of Flink images on Docker Hub, the challenges of fitting a Flink deployment in a Kubernetes-shaped box, and the rough edges of Flink itself that were exposed by this process.
Patrick Lucas, Senior Data Engineer at data Artisans
Apache Flink, a powerful distributed stateful stream processing framework, is an especially good fit for deployment on a containerization platform: its storage requirement is primarily external (e.g. HDFS or S3), clusters often share the lifetime of the jobs that run on them, and the flexibility of allocating resources on such a platform allows for scaling jobs up and down as necessary. In this talk I will give a brief introduction to Apache Flink, then describe the journey to making it a first-class citizen of the container world. I will cover my experience preparing to publish the “official repository” of Flink images on Docker Hub, the challenges of fitting a Flink deployment in a Kubernetes-shaped box, and the rough edges of Flink itself that were exposed by this process.
0:33:10
Flink in Containerland - Patrick Lucas (data Artisans)
0:35:23
Apache Flink in a Container - the Caipi way! - inovex Meetups
0:19:14
Automating Flink Deployments to Kubernetes - Marc Rooding & Niels Dennissen
0:36:30
data Artisans Product Announcement - Patrick Lucas & Robert Metzger (data Artisans)
0:29:51
Jump start large window computations with Hybrid Source
0:27:54
Deploying a secured Flink cluster on Kubernetes - Edward Alexander Rojas Clavijo
0:38:25
Future of Apache Flink Deployments: Containers, Kubernetes and More - Till Rohrmann
0:17:29
Deploying Flink Jobs as Docker Containers - Dominik Bruhn (Relayr)
0:09:07
A demo of Apache Flink with Docker on the BDE platform
0:45:33
Keep it going — How to reliably and efficiently operate Apache Flink - Robert Metzger
0:46:57
Bring Flink to Large Scale Production - Xiaowei Jiang (Alibaba)
0:38:05
From Flink 1.3 to 1.4 - Till Rohrmann (data Artisans)
0:40:50
Flink Forward 2015: Simon Laws – Apache Flink cluster deployment on Docker using Docker Compose
0:40:37
Flink Forward 2016: Stephan Ewen - Running Apache Flink everywhere
0:42:16
#FlinkForward SF 2017: E. K. Joseph & R. Yadav - Flink meet DC/OS – Deploying Flink at Scale
0:42:11
Apache Flink meets Apache Mesos and DC/OS - Till Rohrmann (data Artisans)
0:31:29
Extending Apache Flink stream processing with Apache Samoa ML methods - Piotr Wawrzyniak
0:07:35
Interview with Jamie Grier, Director of Applications Engineering at data Artisans
0:44:19
Build a Real-time Stream Processing Pipeline with Apache Flink on AWS - Steffen Hausmann
0:40:48
Flink Forward SF 2017: Jamie Grier - Apache Flink: The Latest and Greatest
0:37:20
Berlin Buzzwords 2018: Nico Kruber – Stateful Stream Processing with Apache Flink 1.5 and beyond
0:20:21
Scale By The Bay 2018: David Massart, A Reactive Fraud Monitoring Engine for Instant Payments
0:38:11
Time-Based Aggregates: The Good, the Bad and the Ugly - Frank Lauterwald (noris network AG)
0:36:55
Berlin Buzzwords 2018: Frank Conrad – Spark and Flink Running Scalable in Kubernetes #bbuzz
Комментарии