Set up Clickhouse database for Kafka Streaming | Data Steraming | OLAP database | Clickhouse

In this video we will cover a columnar database called clickhouse. We will use Clickhouse as the target database for our Apache Kafka streaming. This will be a perfect match for our stream processing application and real-time data anlaysis. A columnar database is optimized for fast retrieval of columns of data, typically for an analytical application.
ClickHouse® is a high-performance, column-oriented SQL database for online analytical processing (OLAP). It has open source and a cloud base offering. You can use Clickhouse if you need real-time response over a large dataset.

💥Subscribe to our channel:

📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣

-----------------------------------------

#clickhouse #kafka #etl

Topics covered in this video:
==================================
0:00 - Introduction to Clickhouse
0:27 - Row vs Columnar database
2:14 - Clickhouse Set up
2:23 - Docker-compose overview
2:32 - Clickhouse configs
4:05 - Create and Start Cotainers
4:16 - Database connection
5:14 - JDBC Sink Connector
6:33 - Query Clickhouse to view Data Stream

[BiInsightsInc]

I covered the JDBC Setup for the Kafka Connect in the next video. If you enconter any issues with the setup then view the next video:

[abdulquadrioshoare]

Wow, wonderfully explained.
I’ve been following your streaming series and I can say this is the most detailed Kafka video available on the entire internet. More grease to your elbow.

Is it possible to use an online OLAP like Biguery as a sink. Thanks

[JaneChang-tf]

I don't understand. I start the clickhouse service on clickhouse website and created the sales database in the clickhouse website, then suddenly use Postman to test if the kafka works? How to setup the kafka data???

[JaneChang-tf]

And where can we get all the folders and files you mentioned? Do these just popped up and you wrote it all by yourself? I need some logistics.

[navneetsankhla]

Heyy so using this Kafka and all stuff can we create stored procedure for clickhouse database ?

[gunturdwicahyono]

i got this error when try to put the sink connector via thunder
Failed to find any class that implements Connector and which name matches

[akshaybaura]

could you direct us to the source of your jdbc clickhouse connector ?