You have to learn python data processing NOW! | rabbitmq grafana twitter

Hi! Let's create data engineering pipeline using data from Twitter API. We'll use Grafana to visualise them and RabbitMQ for sending. All necessary data processing is done with Python. Let us know if you would like to have more such videos in the future.

Chapters:
00:00:00 Intro
00:00:45 Requirements
00:01:21 Architecture
00:01:46 Repo cloning
00:02:07 Preparation
00:02:55 Running docker
00:03:42 Rabbitmq - dashboard
00:04:11 Grafana demo
00:05:15 How the pipeline works
00:06:19 Grafana Dashboard edit
00:07:35 Grafana - adding widgets
00:09:39 Python Script
00:11:53 Python - Analysis
00:13:01 Python - Persistence

[RezaSafari-qfhh]

This is awsome, thanks for sharing this video.

[skillbits]

Timestamps: 🐦
00:00:00 Intro
00:00:45 Requirements
00:01:21 Architecture
00:01:46 Repo cloning
00:02:07 Preparation
00:02:55 Running docker
00:03:42 Rabbitmq - dashboard
00:04:11 Grafana demo
00:05:15 How the pipeline works
00:06:19 Grafana Dashboard edit
00:07:35 Grafana - adding widgets
00:09:39 Python Script
00:11:53 Python - Analysis
00:13:01 Python - Persistence

[tommasobassignana]

This is great! I always like seeing content that is not the same basic tutorial repeated times and times again!

[rahulmistri]

Great video thanks for the concise information.

[md.ishraquebinshafique]

Hi.
Thank you very much for such an amazing demonstration.
I wanted to know if there is any way to dockerize the python scripts as well so that they can run on startup using the docker-compose file.