filmov
tv
Architecting for Data Quality in the Lakehouse with Delta Lake and PySpark
Показать описание
Join us for a live tech talk and learn about architecting for data quality in the lakehouse with delta Lake and PySpark. After the presentation, we’ll have time for questions. Excited to have you join us!
From null values and duplicate rows to modeling errors and schema changes, data can break for millions of reasons. To combat this, teams are increasingly adopting best practices from DevOps and software engineering to identify, resolve, and even prevent this "data downtime" from happening in the first place. Join Prateek Chawla and Ryan Kearns as they walk through how data and ML engineers can solve for data quality across the data lakehouse by applying data observability techniques. Topics to be discussed include: how to optimize for data reliability across your lakehouse's metadata, storage, and query engine tiers, building your own data observability monitors with PySpark, and the role of tools like Delta Lake to scale this design.
Links:
From null values and duplicate rows to modeling errors and schema changes, data can break for millions of reasons. To combat this, teams are increasingly adopting best practices from DevOps and software engineering to identify, resolve, and even prevent this "data downtime" from happening in the first place. Join Prateek Chawla and Ryan Kearns as they walk through how data and ML engineers can solve for data quality across the data lakehouse by applying data observability techniques. Topics to be discussed include: how to optimize for data reliability across your lakehouse's metadata, storage, and query engine tiers, building your own data observability monitors with PySpark, and the role of tools like Delta Lake to scale this design.
Links:
1:00:49
Architecting for Data Quality in the Lakehouse with Delta Lake and PySpark
1:00:39
Data Architecture Strategies Data Quality Best Practices
1:00:30
Data Architecture Strategies: Data Quality Best Practices
0:43:17
Designing a Data Analytics Architecture with Data Quality in mind
1:00:39
Data Architecture Strategies: Data Quality Best Practices
0:03:53
Data Quality Explained
1:00:07
Data Architecture Strategies: Webinar: Data Quality Best Practices
0:05:25
What is Data Pipeline? | Why Is It So Popular?
2:46:45
What's Hiding in Your DATA That's Costing You Money?
1:01:06
Data Architecture Strategies: Data Quality Best Practices
0:05:22
Data Governance Explained in 5 Minutes
0:59:29
Data Architecture Strategies: Data Quality Best Practices
0:11:11
What is a Headless Data Architecture?
0:06:11
Data Lake Architecture
1:00:39
Data Architecture Strategies: Data Quality Best Practices
0:12:41
Data Architecture vs Management vs Governance
0:06:55
How to Become a Data Architect
0:07:11
Introduction to Data Governance (Data Architecture | Data Governance)
0:49:59
Assuring Data Quality at Scale by Gayathri Thiyagarajan
0:02:20
Measuring Data Quality with Clinical Architecture at ViVE2023
0:59:06
DAS Webinar: Data Quality Best Practices
0:10:06
Explanation Of Data Governance & Data Quality || Difference Between Data Governance & Data Q...
0:08:12
Metadata Management & Data Catalog (Data Architecture | Data Governance)
0:35:40
Improving Revit Data Quality and Control with Naviate Architecture
Комментарии