Big Data Engineering Full Course Part 1 | 17 Hours

preview_player
Показать описание
This Course Cover Complete Big Data Engineering Topics

Resources
========

Hive

Spark

Course Outline

00:00 About Instructor
00:48 All about [What is Big Data]
37:52 Big Data Engineering Road Map
54:45 Hadoop Distributed File System (HDFS)
02:16:39 Unboxing [Hadoop Framework]
02:38:06 Hadoop Single Node Setup
03:14:24 HDFS Quotas Use Cases
03:26:57 MapReduce Complete Video
05:30:33 Apache Hive Introduction & Architecture
05:47:23 Installation [ Apache Hive 2 with MySQL ]
06:00:50 Hive SQL [Create Load Insert Show]
06:19:05 Hive Internal Vs External Table
06:25:53 Hive Partition [ Static Vs Dynamic]
06:43:47 Hive Bucket End to End Explained
07:03:09 How to Decide [Bucket Count] in Hive
07:14:09 Hive Partition with Bucket Explained
07:20:42 Hive ORC File Format with Demo
07:28:18 Hive ACID Table
07:35:09 Hive UDF
07:47:39 Apache Spark Introduction
08:35:18 Apache Spark Installation
08:52:36 Apache Spark Scala Wordcount Program (REPL)
09:05:51 Spark Standalone Architecture

Hash Tags
#bigdata #dataengineering
Рекомендации по теме
Комментарии
Автор

Resource Links has been added and updated

thedatatech
Автор

Amazing content for Data Engineers! It's packed with super useful stuff. Big thanks to the creator for making learning data engineering so much easier. Highly recommend it if you're into this field! 👍👍

BogoluNithishReddy
Автор

Goutham bro really hats offs to you bro ... because your teacher skill is far better than my big data College very easy to grasping the concept on your teaching way....big fan bro 💯

Mininkravu
Автор

Need end to end real time big data engineering projects involving all tech stack like AWS, python and no sql DB

BhakthiYoutube
Автор

Thanks Gowtham brother for bringing up this video that is even free for the community ❤. This will be very helpful in my Bigdata career path.

srirambalraj
Автор

On the story in mapReduce video at 3:38:10. Yes, Hadoop is not dead, but it is facing increasing competition from newer technologies. Hadoop is still a popular choice for big data processing, but it is not the only option anymore. HDFS is replaced with Cloud object storage like Aamazon S3, Azure Blob Storage, and Google Cloud Storage, Data lakehouses. Hive has better alternatices like spark, impala, presto, Athena, BigQuery. Oozie is replaced with Airflow, prefect. The base for all these new technologies is hadoop that's why learning about hadoop is important.

mohitmotwani
Автор

Geniuses still exist.
You are one amazing teaching.
Concepts well explained with real-life examples.
I find it extremely easy to understand every bit of explanation you make.

This is by far the best course to get started with. Thank you @The Data Tech

simonmafanye.
Автор

From datadots till here, it's really nice to see good content on big data technologies..

PatelTech
Автор

This is really good stuff....😀 it will be really helpful for aspirants like me Thanks for enlightening us with the knowledge. Keep going 👏

thoufeequedon
Автор

Thk u so much brother. I learned big data through your videos only.please upload real time project. It will help us to crack the interview easily.

baskerpandian
Автор

Great content, Unparalleled way of you

Manish-uexw
Автор

Thank you so much for your contribution. Helping me a lot.

blhgbdj
Автор

Thanks bro for this Video, I am a Tester with 7 years experience now looking for an upgrade in my career.
I am following your course hoping for the right result, Thank you once again

KiranNayari
Автор

Thanks a lot Gowtham bro for this video, looking forward for sample DE project videos

mohanprasath
Автор

Very nice video, please prepare videos on PySpark end to end project as well. Badly needed!!

ranjansrivastava
Автор

Thanks a lot brother, this will help a lot of people..👍👍

The_Bold_Statement
Автор

Hi bro, all the videos regarding Bigdata are very clear and understandable. Can you make a lecture on "python required for Big Data Engineer"?

ntymfsk
Автор

You are a champp man!. You are a hero man!. Thank you so so so so so much to you. Sending you lots of blessings. God bless you!

vishnujatav
Автор

Thanks bro for this amazing concept with detail and crystal clear

kanimozhipunniyamoorthy
Автор

The session and content on Hadoop are awesome! could you please share the installation steps that we have in notepad?

sanjeevg