Top 10 Interview Answers Explained - Part 2

#bigdata #bigdatainterview #dataengineering

10 Big Data Interview Question That I Ask தமிழ்



Video In English

Video In Tamil

Video Playlist
-----------------------

YouTube channel link

Website
Technology in Tamil & English #DataEngineering #BigData #CloudComputing #DataAnalytics #ETLTutorials #SQLTutorials #DataEngineeringTamil #BigDataTamil #TamilTech #TamilTutorials #TamilITProfessionals #TamilDataEngineeringChannel #HadoopTutorial #ApacheSpark #FlinkTutorial #NoSQLDatabases #MongoDBTutorial #AWSDataEngineering #GCPDataEngineering #AzureDataEngineering #EngineeringStudents #TamilEngineeringStudents #ITCareerTamil #TechJobsTamil #LearnInTamil #TamilTechChannel

Tamil Data Engineering Tutorials, Best Tamil Data Engineering Channel, Data Engineering in Tamil, Big Data Tamil Tutorials, Hadoop Tamil Tutorials, Spark Tamil Videos, Flink Tamil Tutorials, Data Engineering Concepts Tamil, AWS Data Engineering Tamil, GCP Data Engineering Tamil, Azure Data Engineering Tamil, NoSQL Tamil Tutorials, BigQuery Tamil Tutorials, Data Pipeline Tutorials Tamil, Cloud Computing Tamil, Hadoop Tamil Tutorial, Hadoop Ecosystem Tamil, MapReduce Tamil Explanation, Apache Spark Tamil, Spark Streaming Tamil, Spark SQL Tamil, MongoDB Tamil Tutorial, Cassandra Tamil Videos, NoSQL Tamil Explanation, AWS Tamil Big Data Tutorials, Google Cloud Tamil Data Engineering, Azure Data Engineering Tamil, SQL Tamil Tutorials, ETL Process Tamil Videos, Data Warehouse Tamil, Tamil Tech Channel, Data Engineers Tamil Nadu, Tamil IT Professionals, Engineering Students Tamil Tutorials

[sonip]

Thanks for the explanation, very nicely explained.

[nilamaniswain]

Thanks Bro .. Awesome Explanations on ACID & Default PartitionAlgo

[kmk]

Please let me know when you will take interview, I’ll attend the interview 😎since I already knew the answers .

[noysen]

Book is awesome bro.Thanks for valuable share.

[lajpatb.l]

Well explained Gowtham, clear and understandable.
Request you to prepare more questions and possible answer to it.
Please make more videos on use cases.

[abdulsattar]

Thank you, these question are mind-blowing

[amittaywade]

Bro you are amazing :) Thanks for the video !

[sivaranganath]

Thanks for posting videos, its so helpful for us.

[neelbanerjee]

Could please provide some real time use cases for choosing file formats? When to choose orc and when parquet?

[yvuuopo]

If the application has shuffling and default setting is 200 so 200 output part files will be written right

[vijayvarma]

Thanks Gowtham for great explanation.
But repartition can also be used to decrease the partition isn't?

[neelbanerjee]

Great content... you are really filling the gap.. have some doubt and really want to get some good advice from you..
1. I learned pyspark with azure databricks (no real time exp).. trying to build my portfolio project for interview.. like i got some source data in azure blob in file format and processeing those thru databricks pyspark.. is it must to put hive somewhere in my pipeline?
If so how to do that, i mean how to integrt hive with azure..

If possible please create an end to end project video with azure databricks..

Thank u in advance....

[yvuuopo]

How input partions equal to output partitions

[shyamsundar]

Thanks for the video.
Can anyone seeing this comment help me with
Exactly the diff between parquet and orc
and why we prefer one over other in production