12. StructType() & StructField() in PySpark | #AzureDatabricks #Spark #PySpark

In this video, I discussed about StructType() and StructFiled() Classes to create schema for dataframe.

Link for PySpark Playlist:

Link for PySpark Real Time Scenarios Playlist:

Link for Azure Synapse Analytics Playlist:

Link to Azure Synapse Real Time scenarios Playlist:

Link for Azure Data bricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure Logic Apps playlist

#PySpark #Spark #databricks #azuresynapse #synapse #notebook #azuredatabricks #PySparkcode #dataframe #WafaStudies #maheer #azure

[manu]

My humble request... please continue..

[durgasiresh]

Good explanation and great effort & very useful videos Thank you!!

[peerkhaja]

Ur always giving informative videos.. Keep it up maheer

[jeevaraj]

Hi Sir your videos are helpful for me.I learned very much with your videos.... One humble request if is possible means you can do it, Atleast one video per day or 5 videos per week. Thanks in advance

[subhanishaik]

Hi i have one question.how to convert 11/11/2022 1102 to YYYY-MM-DD HH:MM:ss in pyspark

[VinayKumar-stiq]

Abyone help me. For me getting type error while excecutung below code

error
TypeError: __call__() takes 1 positional argument but 2 were given

Code:

from pyspark.sql.types import StringType, StructField, StringType, IntegerType

data = [(1, 'Narendra', 2000), (2, 'Modi', 5000)]

schema = StringType([\
StructField(name='id', dataType=IntegerType()), \
StructField(name='Name', dataType=StringType()), \
StructField(name='Salary', dataType=IntegerType())])

df = spark.createDataFrame(data, schema)

df.show()