BigQuery: Configuring and scheduling queries

preview_player
Показать описание
Are you having trouble creating and running scheduled jobs in BigQuery, and would like to implement it in your production and development pipelines?

Check out this video where we will be discussing BigQuery's scheduled queries feature, and the IAM permissions needed to create and configure them. We will show you how to configure and schedule queries and the configuration options available. Watch this video to learn some important caveats and how to overcome them while using scheduled queries in BigQuery.

Chapters:
0:00 - Intro
0:29 - Scheduling Queries: Prerequisites
1:25 - Demo on creating and configuring scheduled queries
4:30 - Caveat #1 - Scheduled Queries are run as per UTC time
5:10 - Caveat #2 - Running scheduled query in a different region compared to destination table
5:42 - Caveat #3 - Modifying credentials used to run scheduled queries
6:00 - Further reading

Рекомендации по теме
Комментарии
Автор

Hi but when we use service account to run a scheduled query, we are losing the email failure notification feature...are you planning to add a feature to route the failure email to the desired recipients?

ajaysakalabhaktula
Автор

can you give example of custom Schedule here.

requirement:
every Saturday of month this option and second requirement every 4 th saturday of month

mechanicalbrand
Автор

How to choose partition by month instead of day? I have more than 4000 days in my table and i'm getting an error

beckyivan
Автор

Every 5 minutes we can schedule query. This video is out dated.

vishnuvarthan