Big Data Engineering Full Course Part 2 | 17 Hours

This Course Cover Complete Big Data Engineering Topics

Resources
=========

Hive

Spark

Course Outline

00:00 Unboxing Spark RDD
11:03 Different Ways to Create [Spark RDD]
14:48 Spark Transformation Types and Actions
27:58 Spark Executor Core & Memory Explained
36:03 Spark [Executor & Driver] Memory Calculation
42:12 Spark Submit Cluster [YARN] Mode
55:03 Spark Lens Integration [Spark Application]
01:05:03 Spark [Hash Partition] Explained
01:22:01 Spark [Custom Partition] Implementation
01:28:36 Spark With JDBC (MYSQL / ORACLE)
01:42:02 Apache Spark UDF
01:50:23 Spark - Repartition Or Coalesce
02:00:08 Apache Spark SQL With Apache Hive
02:08:24 Spark reduceByKey Or groupByKey
02:20:12 Spark Dedup With Use Cases
02:28:59 Is PySpark UDF is Slow Why
02:34:31 Spark - Calculate Moving Average
02:43:02 Spark Market Basket Algorithm
02:50:56 PySpark Calculate Frequency Table
02:55:10 PySpark Types of Drop Null Records
02:59:46 Print Spark Data Lineage
03:04:50 Spark Logical & Physical Plan
03:13:01 Hadoop Multi Node Cluster Setup
03:42:20 Spark Kafka Cassandra End to End Streaming Project
04:12:29 Big Data - On Premise Or Cloud
04:15:07 Do Data Engineers Need Cloud Computing
04:19:12 Big Data On Cloud AWS EMR
04:36:55 Google Dataproc BigData Managed Service
04:52:22 Google Dataproc and BigQuey Project
05:03:43 Apache SQOOP Data Migration POC
05:29:26 Top 10 Points to Explain Big Data Project In Interview
05:42:08 Top 10 Interview Q & A Explained
05:58:58 Big Data Engineering Resume Preparation
06:21:04 Big Data Project Explained
06:40:58 4 Ways For Data Engineers To Make Extra Income
06:45:45 Big Data Project Deployment Explained
06:58:25 How to get Latest Data Engineering News

𝐒𝐨𝐜𝐢𝐚𝐥𝐬

Hash Tags
#bigdata #dataengineering #DataEngineering #BigData #DataPipeline #ETL #DataProcessing #DataScience #DataAnalytics #DataWrangling #DataOps #DataArchitecture #DataIntegration #DataTransformation #DataStorage #DataManagement #DataPlatform #CloudDataEngineering #AWS #Azure #GCP #DataCloud #CloudComputing #CloudDataPipeline #DataStreaming #Kafka #Spark #Hadoop #NoSQL #DataModeling #DataGovernance #DataLake #DataWarehouse #Redshift #BigQuery #Snowflake #DataVisualization #MachineLearning #AI #APIs #DatabaseManagement #ServerlessComputing #DataMigration #DevOps #MLOps #DataOrchestration #DataAutomation #DataSecurity #CloudMigration #DataEngineeringCommunity #RealTimeData #DataMonitoring #DataEngineeringTools #DataInsights #DataDriven #DataQuality #DataEngineeringProjects #PythonForData #SQL #DataPipelinesSimplified #CloudETL #ModernDataStack #CloudDataOps #DataLakehouse #AnalyticsEngineering #DataFlow #CloudIntegration #DataTools #DataPipelineAutomation #DataModelingSimplified #ETLTools #DataProcessingPipeline #DataCloudExperts #ServerlessData #CloudComputingSolutions #BigDataAnalytics #AdvancedAnalytics #DataInnovation #CloudDataManagement #DataOpsFramework #ETLProcesses #StreamingDataPipeline #DataScienceWorkflow #CloudEngineering #DataEngineerLife #DataEngineerJobs #DataEngineeringForBeginners #CloudSolutions #TechForData #DataScienceCommunity #CloudFirst #DataStorageOptimization #CloudETLTools #DataProcessingFrameworks #RealTimeAnalytics.

[golgappa]

my god ! what a top notch content. Wish to see advance content in part 3. Hats off for your efforts 👒💥

[zamirdr]

Great coverage, simplified explanation, Thank you!

[manisaikatakam]

It was amazing and simplified content. Pls don't stop this series
And next coming part pls do with practical. It will helpna lot

[explained]

I would say just one word Simply Awesome!

[portiseremacunix]

finished the part 1 and now part 2. thanks.

[gsekhar]

I like very much your way of teaching and the content u provide thank u and all the best bro

[SunkuSaiVamsi]

Thank you bro, Kindly start course on spark please

[kotamrajusurya]

Thank you very much sir for your great efforts and time

[RaviYadav-cxpb]

I have 5 years of experience in Java.. how to update resume for data engineer how to convince to interviewer I'm fit for thet job

[himanshubhat]

Hi, can you make or share some video for Implementing SCD 1 and SCD 2

[Bheemraj_]

Can you do videos on complete data analysis

[fashionvella]

Big Data, Software Engineering combo is good or not ?

[devamurugansankaran]

Can you explain how can we run whole data pipeline in kubernetes

[prakashmishra]

Great content, great explanation, I'm mechanical engineer, came here to learn basics, only arrow in my Tarkash is Python, But looks like "you are DronAcharya, JAVA is Arjun and Python is Eklavya. 😉😆

[sauru_]

I am beginner in data engineer
I want to start from scratch how much will these two parts will help me
Part 1, Part 2

[asktostranger]

Do we get part 3
For advance folks ?❤

[navanikrish]

Hi Im planning to make a switch from datastage etl developer to a data engineer using python and pyspark whether these 2 parts and sql knowledge enough to crack a interview for a 2.7 yrs exp candidate..correct me if im wrong..please guide me on this

[naveenkumarkoduri]

Thank you, can we have timestamps for each topic in video