End to End Modern Data Engineering with DBT (Data Build Tool)

preview_player
Показать описание
Join us as we dive deep into the powerful combination of DBT and BigQuery, the game-changers in modern data engineering. Whether you're a beginner or looking to refine your skills, this tutorial has got you covered!

Unlock the full potential of your data and stay ahead in the analytics game!

⚡️ What You'll Learn:
00:00 🌐 Introduction to DBT & BigQuery
01:27 🛠 Setting up DBT and BigQuery from Scratch
08:00 🔗 Linking DBT and BigQuery
16:13 📝 Writing SQL-based Transformations with DBT
21:27 🔄 Converting Tables to Views with DBT
23:00 📊 Seeding data to BigQuery with DBT
25:00 💡 Writing tests with DBT
27:16 📑 Generating Documentation with DBT

🌟 Please LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟

🌟 Resources and Links:

🌟 Hashtags:
#DataEngineering #DBT #BigQuery #AnalyticsTutorial #DataScience2023

🌟 Tags:
DBT, BigQuery, Data Engineering, SQL Transformations, Google Cloud Platform, Data Analytics, Modern Data Stack, Data Warehousing, ETL Process
  1. CodeWithYu
  2. BigQuery
  3. Data Engineering
  4. SQL Transformations
  5. Google Cloud Platform
  6. Data Analytics
Рекомендации по теме
The four levels 0:00:59

The four levels of data engineering!

End to End 0:30:13

End to End Modern Data Engineering with DBT (Data Build Tool)

StreamSets | DataOps 0:03:55

StreamSets | DataOps for Modern Data Integration | End-to-end Platform for Smart Data Pipelines

What is Data 0:05:25

What is Data Pipeline? | Why Is It So Popular?

Building an End-to-End 0:33:44

Building an End-to-End Data Stack in Thirty Minutes | Mode

Building Robust Data 1:59:29

Building Robust Data Pipelines for Modern Data Engineering | End to End Data Engineering Project

Data Pipeline Overview 0:00:58

Data Pipeline Overview

AWS re:Invent 2023 0:56:22

AWS re:Invent 2023 - Build an end-to-end data strategy for analytics and generative AI (ANT331)

Modern Data Analytics 0:34:46

Modern Data Analytics in the Cloud: Achieving an End-to-End Strategy

Data Science in 0:55:53

Data Science in Azure: End-to-End Data Analytics using Azure Databricks

Use The Modern 0:25:50

Use The Modern Data Stack All In One Platform | Datacoves

ETL vs ELT 0:04:42

ETL vs ELT | Modern Data Architectures

How to Build 0:12:24

How to Build Modern Data Architectures (faster & with more structure)

Setting up a 0:34:11

Setting up a Modern Data Stack for your Startup - An Easy 6-Step Guide

Modern Data Architecture 0:01:28

Modern Data Architecture using Microsoft Azure - learn Microsoft Azure

Building a modern 0:35:03

Building a modern end to end open source Big Data reference application

CI/CD for Modern 1:09:45

CI/CD for Modern Data Engineering | End to End Data Engineering Project

Develop your Data 0:07:41

Develop your Data Strategy

Data Pipelines Explained 0:08:29

Data Pipelines Explained

Datacoves End to 0:02:20

Datacoves End to End Analytics for Modern Data Teams

Kubernetes for Modern 1:25:18

Kubernetes for Modern Data Engineering: An End to End Data Engineering Project

Open Source Powers 0:31:44

Open Source Powers the Modern Data Stack

Y42: End to 0:51:48

Y42: End to End Data Pipeline as Code

Jean Joseph: Building 0:38:20

Jean Joseph: Building End-To-End Modern Data Warehouse with Azure Synapse Analytics

Комментарии
Автор

Thanks for watching! Hit the LIKE button, SUBSCRIBE and comment for wider reach 🥺🙏

CodeWithYu
Автор

I was struggling with understanding DBT, but this video cleared everything up for me. You should have over a million subscribers with quality content you have. Keep it up! We appreciate you.

tech-n-data
Автор

Few things to note in the profiles.yml file if you are following this tutorial.
1. Also update the method: oauth to method: service-account.
Great tutorial

HenryKpano
Автор

Good video man. Would be cool if you also made a CI pipeline tutorial with something like github actions for dbt + BigQuery.

dunkfluga
Автор

Great tutorial! thanks
I'll try it implementing Snowflake instead. Let's see 🤞

RafaVeraDataEng
Автор

waiting for more GCP and DBT end to end projects!💫

wiss
Автор

really good crash course Yu, thank you very much for this 🙂

MiguelTorres-fpjr
Автор

Hi great video, quick questions:

1) From where the "profile.yml" file came from after 5:58 ?
2) After 26:10, have you deleted the "example" folder under "models" folder ? If yes, then why ?

abdurrehmansiddiqui
Автор

Nice tutorial. I would like to know how did you load "dbt-tutorial" dataset just by typing it in "Star a project" between 15:12 and 15:40 ?

kailashneupane
Автор

hi im confused at the 5:55 when you're draging profile yaml....where did it actualy came from ? thanks in advance

renvils
Автор

i am sorry but this is really unorganized and very confusing. You lost me with this long setup full of errors. it could be better

VRProject-qcsy