Data Warehousing With BigQuery: Best Practices (Cloud Next '19)

Показать описание

Take an in-depth look at modern data warehousing using BigQuery and how to operate your data warehouse in the cloud. During this session, we'll give lessons learned and best practices from prior implementations to give you the playbook for implementing your own modern data warehouse.

Watch more:

Speaker(s): Ryan McDowell, Alban Perillat-Merceroz

Session ID: DA307
product:BigQuery; fullname:Ryan McDowell; event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Data Analytics - BigQuery; fullname: Ryan McDowell;

Рекомендации по теме

Комментарии

At 13:36, why do we need to load into GCS first for batch loads? Can't we use Dafaflow/BigQuery BatchLoad / Data Fusion directly from GoldenGate?

jennwng

Beautifully explained. Many thanks. Now, why wouldn't anybody want to move to the sunny side of France and land a job at Teads !! Both of the presenters did an excellent job.

anandakumarsanthinathan

the best 'best practice' sharing session i ve ever had

kunfang

At 11:58 why DataFlow / Data Fusion can speed up pipelines? Like, the essence is either to do the transformation in BigQuery or in DataFusion. Even if the query is complex, won't it still be faster to do the transformation directly in BigQuery, rather than connecting to DataFusion and transforming data there?

jennwng

At 13:35, what is the benefit of loading data from Oracle into GCS first and then BigQuery (i.e. won't directly loading into BigQuery from Oracle be faster)? I know GCS can serve as a staging area and we get another copy of the data for fault tolerance, but is there any other benefit? Thanks :)

LuckyHongTJ

How to perform sum of columns value in big query. And no of columns are notfixed, at runtime we need to decide no of columns need to consider for sum. Depends on user inputs

TheMitali_

6:30 do nada aparece uma nota de dez conto hahaha adorei

Thiago

Hello, will you also share the slides? Thank you

Vinch

H thanks u so much love you amiee Wright and Bella daws Xxxxx

amieewright

Kafka to S3 and S3 to Cassandra via Spark is wrong approach.

sunilpipara

Data Warehousing With BigQuery: Best Practices (Cloud Next '19)

Data Warehousing With BigQuery: Best Practices (Cloud Next '19)

Modern Data Warehousing with BigQuery (Next ‘19 Rewind)

Database vs Data Warehouse vs Data Lake | What is the Difference?

Modern Data Warehousing with BigQuery (Cloud Next '19)

[Data Analytics] Data warehousing using BigQuery

Modernize your data warehouse with BigQuery

Data warehousing and Analytics using Google Bigquery

Building the World's Largest Enterprise Data Warehouse with BigQuery (Cloud Next '18)

Using BigQuery as a data warehouse in B2B startup – Denys Tkalich

Reimagine data warehousing with Google BigQuery

Migrating your data warehouse to Google BigQuery: Lessons Learned (Google Cloud Next '17)

BigQuery Tips: Nested and Repeated Fields and How GOJEK Builds Data Warehouses (Cloud Next '19)

Google BigQuery - The Modern Cloud Data Warehouse | DataHour by Saurav Roy

What is BigQuery?

Setting up Google BigQuery as a data warehouse in minutes

Building A Petabyte Scale Warehouse in BigQuery (Cloud Next '18)

3 most common data modeling interview questions

BigQuery Architecture

BigQuery, Google’s Enterprise Data Warehouse

KNOW the difference between Data Base // Data Warehouse // Data Lake (Easy Explanation👌)

Reimagine Data Warehousing: How The Home Depot is Using BigQuery to Scale (Cloud Next '19)

Build a Marketing Data Warehouse in Google BigQuery with Supermetrics

Cloud Data Warehouse Benchmark Redshift vs Snowflake vs BigQuery | Fivetran

How to migrate a data warehouse to BigQuery