Real-Time Apache Spark Project | Data Analysis | Structured Streaming | Part 6.1 | DM | DataMaking

==============================================================================

Data Engineering Case Study/POC Projects: Please watch the complete video series of this project, to explore more details on this project.

==============================================================================

New Apache Spark Project: Building Real-Time Sales Dashboard using Apache Spark, Apache Kafka and Python Django

Hi Friends, we are giving FREE offer for our course till tomorrow(upto 23:59 PM), this exclusive offer only for DataMaking channel's learners & supporters 🙏

==============================================================================

==============================================================================

Development Environment as Virtual Machine(VM) for FREE:
You can get it from the below Url

==============================================================================

YouTube Playlist Link:

==============================================================================

PySpark Tutorial

Happy Learning!

[DataMaking]

Please watch the complete video series of this project, to explore more details on this project. Please check description section of this video for more details.

[NN-HCK]

Can you specify which path you gave for the spark.jars?
I'm not able to get the accurate path.
Can you please get a bit precise?

[sachinjagtap]

Hello Sir,

I am having difficulties while getting dependency jar's for Cassandra, sql, pySpark . could you please help . Thanks

[chelseafernandes]

Sir, how to make a generalized version of this? I mean everywhere here you're creating a schema because you know content of data... What if I want to make app which takes any CSV n does analysis using all these technologies?

[sachinjagtap]

Hi Sir, The config files while creating SparkSession - I am not able to locate the path . is it existing path or we are explicitly giving it ? Please explain

[tosarvesh]

Where is data and files related to this project?any git repo url?

[SpiritOfIndiaaa]

nice, have one doubt, why are you saving the data into cassandra ? is it a stag table ? what advantages we get ?

[HariKrishna-vswf]

Hi..
the order data we are geting from producer stores in Kafka brokar default (hdfc) and the customer data your taking from hdfc right.. so first your getting customer data through Kafka producer and storeing in hdfc while getting order data ur using joins for aggregation right..?

[SurajitMetya]

Hi Sir, can you plz provide the link for data_processing.py file, Thanks in advance!

[ericfonsi]

Can I get the code of data_processing.py file?

[rajasekhar]

Hi, hope u r doing good, please upload same project on scala instead of python , it will be useful. I am not python background, do next project on scala and spark and kafka and spark streaming

[flamboyantperson]

Do it in jupyternotebook that is more clear than pyspark

[sachinjagtap]

Hello Sir,

I am having difficulties while getting dependency jar's for Cassandra, sql, pySpark . could you please help . Thanks