15. deloitte azure databricks interview questions | #databricks #pyspark #interview #azure

#azuredatabricks #pyspark #sql #ssunitech #adf #adb
#Databricks #PysparkInterviewQuestions #deltalake

deloitte PySpark second round interview questions and answers?
PySpark interview q & a?
Databricks interview question and answers?
Azure Databricks #spark #pyspark #azuredatabricks #azure
In this video, I discussed deloitte PySpark scenario based interview questions and answers.

deloitte pyspark interview questions and answers?

Create dataframe:
======================================================
data=[(1,'John','ADF'),(1,'John','ADB'),(1,'John','PowerBI'),(2,'Joanne','ADF'),(2,'Joanne','SQL'),(2,'Joanne','Crystal Report'),(3,'Vikas','ADF'),(3,'Vikas','SQL'),(3,'Vikas','SSIS'),(4,'Monu','SQL'),(4,'Monu','SSIS'),(4,'Monu','SSAS'),(4,'Monu','ADF')]
schema=["EmpId","EmpName","Skill"]
display(df1)
-----------------------------------------------------------------------------------------------------------------------
display(df2)
---------------------------------------------------------------------------------------------------------------------
display(df3)
============================================================

Learn PySpark, an interface for Apache Spark in Python. PySpark is often used for large-scale data processing and machine learning.

Azure data factory tutorial playlist:

ADF interview question & answer:

1. pyspark introduction | pyspark tutorial for beginners | pyspark tutorial for data engineers:

2. what is dataframe in pyspark | dataframe in azure databricks | pyspark tutorial for data engineer:

3. How to read write csv file in PySpark | Databricks Tutorial | pyspark tutorial for data engineer:

4. Different types of write modes in Dataframe using PySpark | pyspark tutorial for data engineers:

5. read data from parquet file in pyspark | write data to parquet file in pyspark:

6. datatypes in PySpark | pyspark data types | pyspark tutorial for beginners:

7. how to define the schema in pyspark | structtype & structfield in pyspark | Pyspark tutorial:

8. how to read CSV file using PySpark | How to read csv file with schema option in pyspark:

9. read json file in pyspark | read nested json file in pyspark | read multiline json file:

10. add, modify, rename and drop columns in dataframe | withcolumn and withcolumnrename in pyspark:

11. filter in pyspark | how to filter dataframe using like operator | like in pyspark:

12. startswith in pyspark | endswith in pyspark | contains in pyspark | pyspark tutorial:

13. isin in pyspark and not isin in pyspark | in and not in in pyspark | pyspark tutorial:

14. select in PySpark | alias in pyspark | azure Databricks #spark #pyspark #azuredatabricks #azure

15. when in pyspark | otherwise in pyspark | alias in pyspark | case statement in pyspark:

16. Null handling in pySpark DataFrame | isNull function in pyspark | isNotNull function in pyspark:

17. fill() & fillna() functions in PySpark | how to replace null values in pyspark | Azure Databrick:

18. GroupBy function in PySpark | agg function in pyspark | aggregate function in pyspark:

19. count function in pyspark | countDistinct function in pyspark | pyspark tutorial for beginners:

20. orderBy in pyspark | sort in pyspark | difference between orderby and sort in pyspark:

21. distinct and dropduplicates in pyspark | how to remove duplicate in pyspark | pyspark tutorial:

[ashishsharan]

Please add more pyspark interview questions, all are very helpful

[chetanmavale]

the idea of giving code in description is the best keep it up

[vikashpatel]

Very good question and nice explanation

[patriotbharath]

nice explanation, please add code to all problem and videos

[gauravpratap]

One small suggestion.... Can you please explain the function that you have used i.e collect list .... Because you know that this function will be used but we don't know why only this can be used

[prabhatgupta]

Can u create a video how to prepare for first second round in deloitte?
Question like roles and responsibility, day to day task, memeory management like that.
I am not talking about sql pyspark video those u have already included. Bring something which is not there on utube.People get stuck at these rounds

[ashishsharan]

Do I need to pay any amount for getting all interview questions and their explanation