Flink SQL Tutorial - a Gentle Introduction

This video is a hands-on guide to Flink SQL. We'll talk about how Flink works, how SQL is possible on streaming data, various components of Flink that allow SQL queries, and some major stateful, stateless and temporal Flink SQL queries you can run. The code example is for a fictitious array of IoT sensors, which we analyze in Flink and make decisions about them (e.g. if they cross a threshold by too much, issuing alerts).

Contents:
0:00 intro, code setup
6:38 Flink SQL with Kafka
21:47 Flink SQL query examples

Follow Rock the JVM on:

-------------------------------------------------------------------------
-------------------------------------------------------------------------

[Arcane]

Hey Daniel, out of curiosity is there a reason behind the switch to making more Kotlin content? 🙂

[sarfarazhussain]

Hi Daniel,
Why not Scala but Kotlin? Is Scala going to be dead in the near future?

[scrans]

Hi Daniel,

I have just finished a data engineering training course (in-person), before that I finished a Master's degree in Chemistry (a computational project) and I have been writing a lot of scala lately after doing some fp stuff (the odersky coursera course and red book). I have not been having much luck with my job search (looking for data engineering jobs, python and scala) though.

I am currently doing a data eng project in scala (web scraping, spark on gcp, gonna make a frontend to show some graphs) to try to prove that I have some skills as the work I done in the training course isn't allowed to be released.

Do you think it is feasible for my first job to be a scala position as a non-cs grad? Frustrating as I've been loving learning fp and especially love typed dataset api in spark! But might have to abandon scala and do some python projects to improve my job search

Thanks