Skew Mitigation For Facebook PetabyteScale Joins

preview_player
Показать описание

About:
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.

Connect with us:
  1. Databricks
  2. Databricks
  3. Skew Mitigation
  4. Facebook
  5. PetabyteScale
  6. Joins
Рекомендации по теме
Skew Mitigation For 0:23:49

Skew Mitigation For Facebook PetabyteScale Joins

Cosco An Efficient 0:38:55

Cosco An Efficient Facebook Scale Shuffle ServiceBrian Cho Facebook,Dmitry Borovsky Facebook

Databricks Whitelabel: Making 0:18:09

Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Customers

Handling Skewed Data 0:18:31

Handling Skewed Data | Tips on running Spark in Production | Course on Apache Spark Core | Lesson 25

Securing Apache Spark 0:27:33

Securing Apache Spark Applications at Facebook

Apache Spark AQE 0:18:16

Apache Spark AQE SkewedJoin Optimization and Practice in ByteDance

Apache Spark 3.0 0:09:54

Apache Spark 3.0 and skew join optimization in the Adaptive Query Execution

34. Databricks - 0:15:03

34. Databricks - Spark: Data Skew Optimization

Spark SQL Join 0:17:18

Spark SQL Join Improvement at Facebook

How To Use 0:40:34

How To Use Salting Technique In Spark: Salting | Intellij | explode | concat

Optimizing the Catalyst 0:26:30

Optimizing the Catalyst Optimizer for Complex Plans - DAIS NA 2021

Flash for Apache 0:26:59

Flash for Apache Spark Shuffle with Cosco

eBay’s Work on 0:13:20

eBay’s Work on Dynamic Partition Pruning & Runtime Filter

SOS - Optimizing 0:31:06

SOS - Optimizing Shuffle (Brian Cho and Ergin Seyfe)

Query or Not 0:26:02

Query or Not to Query? Using Apache Spark Metrics to Highlight Potentially Problematic Queries

Broadcast Joins & 0:20:37

Broadcast Joins & AQE (Adaptive Query Execution)

Manifold: Storage Platform 0:18:38

Manifold: Storage Platform Consolidation | Jacob Lacouture

SparkExecutorMemoryCalculation 0:48:14

SparkExecutorMemoryCalculation

Ariel Weisberg - 0:24:04

Ariel Weisberg - 5 Ways Facebook’s Ludicrous Usage Drives Presto Innovation - Percona Live 2021

Accelerating Apache Spark 0:32:41

Accelerating Apache Spark Shuffle for Data Analytics on the Cloud w/ Remote Persistent Memory Pools

Eliminating Shuffles in 0:32:01

Eliminating Shuffles in Delete Update, and Merge

Apache Spark for 0:31:45

Apache Spark for RDBMS Practitioners: How I Learned to Stop Worrying and Love to Scale- Luca Canali

Challenges in Mirroring 0:28:35

Challenges in Mirroring Large MySQL Systems to HBase - Data@Scale

Opening the Floodgates: 0:34:52

Opening the Floodgates: Enabling Fast, Unmediated End User Access to Trillion-Row Datasets with SQL

Комментарии
Автор

Good session 👍 good to know real world scenario

karthiksitharam
Автор

for which version of Spark is this ? They talk about Skew hint but it is only available in Spark 3.0

rishigc