Fast Data Loading & Bulk Ingestion in Snowflake | Chapter-9 | Snowflake Hands-on Tutorial

This tutorial & chapter 9, "Fast Data Loading & Bulk Ingestion in Snowflake" helps data developers to understand the bulk data loading and data ingestion concept in snowflake. Snowflake allows different stages and different kinds of file formats to support different use cases to load data ingestion. Many projects and developers struggle to understand the stage and file format concept and that's what this video tutorial helps them with.

This hands on visual guide covers following, most important features with live examples
1. User Stage
2. Table Stages
3. Internal Stages
4. Query Stages (Semi structured data)
5. File Format & Copy command
6. Copy Command options - pattern and file validation
7. Copy Command Performance - Compression & Warehouse Size

So enjoy this video series and provide your valuable feedback.

🚀 🚀 Chapters 🚀 🚀
-----------------------------------------
➥ 00:00 What so special about snowflake new objects
➥ 00:52 Welcome Note
➥ 01:33 Covered in this Chapter 09
➥ 02:00 Course Tree Map
➥ 03:09 Why to subscribe this channel
➥ 04:05 Stage Concepts and type of stages
➥ 09:16 User Stage & list them
➥ 12:12 Table Stage & list them
➥ 13:40 List stage objects before copying
➥ 15:30 Loading Data from stage to table
➥ 24:58 Copy & Copy History
➥ 33:00 Role of file format in copy command
➥ 36:50 Query stage data without loading
➥ 40:03 Stage file validation during copy command
➥ 45:01 Role of warehouse size & compression during data loading

🚀 🚀 Snowflake Tutotorials (Beginners) All Episodes 🚀🚀
---------------------------------------------------------------------------------------------------
➥ Chapter-25 (Part-1) Snowflake & PowerBI Reporting 🌐 coming-soon
➥ Chapter-25 (Part-2) Snowflake & Tableau Reporting 🌐 coming-soon

🚀 🚀 Snowflake Certification Complete Guide & Question Dump 🚀 🚀
-----------------------------------------------------------------------------------------------------------------

#snowflakecomputing #dataloading #dataingest #fastdataload #snowflaketutorial #snowflakeobjects #snowflakedatawrehouse #snowflake #dataengineeringsimplifed #DESimplified #toppertips #fastdataloading

Disclaimer: All snowflake-related learning materials and tutorial videos published in this channel are the personal opinions of the data engineering simplified team and they're neither authorized by nor associated with Snowflake, Inc.

[NandhiniRamakrishnan-ow]

I am a BI Engineer and trying to expand my portfolio to Data Engineering as well! Man, no paid courses give such realistic demos and explanations in real-time scenarios. Thank You for teaching us all free. This course is amazing and wonderfully curated.

[karthikamir]

One of the best videos in recent times with perfect voice over, screen presence and sharp one liners .... kudos

[lucasgymnastics]

Hi Thanks for all your hardwork and I cleared my certification and I must say your videos helped a lot . Appreciate all the good work 👍

[dharmeswaranparamasivam]

Very good performance demonstration at the end. Great knowledge. Lot of concepts explained in this video. no words to say!.... keep up your good work. Feeling happy that I found this playlist to learn Snowflake.
Thanks for all your knowledge sharing.

[poojadakhole]

Very well explained. I will surely watch all the videos. I have joined a paid class for snowflake but this is far better. thank you

[snehalujalambe]

I am learning so much from your videos. Thankyou so much for taking out time and making an effort for all these videos which are helping so many people like me. Thankyou Again

[abhijitmohanty]

Sir, I am very happy that these videos are available on YouTube for free to all. Your efforts are very much appreciated and thank you so much for very extensive level of knowledge sharing. 👏👏👏. My request is please do share us the slide that you prepared for demonstration. I t would really help us the keep the note for the specific chapter. I again thank you so much for your effort and level of explaining.

[thamilkadavarayar]

Quick and well explained in a way that you will get an overview of the stages.

[arvindwalikar]

Thank you for preparing these videos, they are really very helpful. Well explained and you have covered all the topics in snowflake. Appreciate your work Sir. Thank you again

[Zabey]

Thank you for putting all these valuble informations in one place. I am a novice user and I am searching for Disaster Recovery options in snowflake. It would be great if you can make a video about the same. Thanks again for your 'good samaritan' attitude.

[MonicaGarg-vp]

Thank you for series of informative videos on various topics on Snowflake. I could carry out lot of important implementations in my project.
I have One question on bulk data load, here you have explained how we can copy or load data into internal named or un-named stage from the file stored on local disk but in actual scenario, bulk data to be loaded from database either on premise or DB on any other cloud. In this scenario how to copy data to internal stage?

[jyothiganta]

What a great series of videos on Snowflake! Really hats-off to the way you are presenting without even wasting a single second and lots and lots of info. Probably we may not even get this much info on the paid courses. Great work.
One small thing, where can I find the queries and commands that you hare showing on your worksheets. They are really helpful for us to practice and verification of our practice. Again, its an awesome videos!

[salmansayyad]

Salute to your passion and hardworking for the such lengthy video with no time waste at all. Is your course on udemy?

[olaminasipac]

Hello. Always great work and really well done videos. Thank you ! 🥇
Remark : isnt there an error in the put parquet file command :
time video : 26:21
Table created is "customer_parquet_ff" and table stage used in put command is "customer_parquet" . that dont match, am I rigth ?

thk you
🤟

[fionafu]

like your presentation, make the topic you try to introduce very clear and easy to follow.

[keylahernandez]

thank you very much for sharing all this information and the best for free for us

[neelamkhanna]

This is remarkable compilation. Could you please point to the weblink url to see get a copy of the sql statements. the webpage shared does not have content sorted by the playlist videos. Thanks and much appreciated!!

[Buzzingfact]

Nice video and thank you for creating videos on snowflake

[sitaramparida]

Personally I feel the way of explanation is awesome!

[sandipmore]

This is very good and informative info. Thanks for putting efforts really appreciated.
I am still trying to understand how come its super fast loading millions of data file to table in seconds. What internally this tool does to do that?
Also if you increase the nodes it become faster but in real life your data is always have constraints, indexes, triggers, primary/composite keys, partitions so in that case what will happen? Like in HDFS and AB Initio MFS your data in file gets distributed and then each node, CPU+main memory work only on that part of data to do it faster, what happens in snowflke, what type of loads it supports.
May be I have to go through all videos but I need to practically do and understand.
Thanks again its really great content to start