Terraform: Reshaping the Data Engineering Experience - Andrei Tserakhau

In this workshop, Andrei Tserakhau, Tech Lead at DoubleCloud, gave a hands-on tutorial about using Terraform for data engineering projects.

He explained how to leverage Terraform to manage and automate data infrastructure, focusing on practical applications and integration with cloud services for data engineering.

0:06 Introduction of the speaker and the session's context
1:00 Overview of Terraform's role in data infrastructure
3:05 Terraform's features and cloud compatibility
4:01 Demonstrating Terraform operations: init, plan, apply
6:04 Discussion on providers and their role in Terraform
9:10 How data sources integrate with existing resources in Terraform
10:41 Role of Terraform state in infrastructure management
13:06 Use of modules and variables to streamline infrastructure
16:00 Setting up AWS instances with Terraform
19:52 Google Cloud setup with VPC and subnet configurations
23:08 Importance of VPCs for security in cloud infrastructure
28:05 Building data infrastructure with Double Cloud and Terraform
36:03 Integrating data workflows and tools in the cloud with Terraform
44:01 Q&A on Terraform practices and certifications

🔗 USEFUL LINKS

🔗 CONNECT WITH Andrei

🔗 CONNECT WITH DataTalksClub

🔗 CONNECT WITH ALEXEY

🎙 ABOUT WORKSHOPS
At DataTalksClub, we organize live workshops with hands-on tutorials about different topics related to data. During these workshops, we use tools to tackle the stated task. You can follow along and practice with us or review the code after the event.

We stream workshops on YouTube, where each session is also recorded and published on our channel, complete with timestamps and important links.

📚Check our free online courses

👋🏼 GET IN TOUCH

[yolo-ysnf]

This was an awesome overview. Thanks guys!