How I Use Python as a Data Engineer

USE CODE: COMBO50 for 50% off

In this video, I have talked about how I use python as a Data Engineer and shared my learnings and best practices I have learned in the last 5 years.

🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟

Timestamps
0:00 Intro
0:38 Building Data Pipeline using Python
0:51 Data Sources and APIs
1:43 Data Extraction Code
2:14 Data Transformation
2:56 What is Data Pipeline
4:15 Data Storage
4:41 Data Pipeline Deployment
6:44 Course - Python for Data Engineering
7:04 Free Roadmap - Python for Data Engineering

3 Books You Should Read

Tech I use every day

✨ Hashtags ✨
#dataengineering #python #airflow

[DarshilParmar]

Tried new way of editing, let me know if you like this format. Also new project is coming soon on GCP so don't forget to hit LIKE button

[samiiiiii]

This was really great short and completely on point. Thank you.

[moeen]

Thank you for the clear and crisp summary.

[craftymehreen]

Brother ... learning a lot from you .. Dedication determination and focus ...Thank you so much :)

[bamidelak]

I think Im loving the way you lecture. Just followed you on twitter and have subscribed to your channel. I want to verge on Data engineer path. Python doesn't stick to my brain or let me say I am being impatient. Any link to learn python fast and understand better? Atlas I can be doing some data ingestion, Minning and visualisation like you

[karangupta_DE]

Great video. Recently I have seen a lot of companies encouraging graphql to query their API.

[prasadbbd]

Good one, covering the overview of DE

[jerbear]

hey darshil, how does python (as you described your process in the video) fit in a cloud platform, such as aws/gcp/azure

[nagulmeerashaik]

Hiii.. Can you do the azure data engineering projects end to end for one plssss

[playwithvihaan]

Amazing video.May I know which editing software are you using?

[mohitbhatia]

I haven’t added any comment on any video on youtube till now, I’m following you and your videos since more than a year, your content for Data Engineering is tooo amazing among all the other data engineers channels.
Keep up the good work buddy!

[rajulsahu]

Very informative video.
Lots of information covered in simple terms.

[payalbhatia]

This is great, Darshil. This video gives some really wise nugget of knowledge, which is at times hard to get at workplace even and also in any other courses. You have explained it so simply. I am quite experienced but took a long route to understand. You are doing it for free, . Great Job

[praveenbhandari]

What is the best way to make a logic building in python tell me some steps

[innovativewaves]

can you please suggest some budget laptops for student studding data engineering.

[ranjansrivastava]

Please share your Python training video for Spark.

[viral.jhgggg]

I am learning AWS Refshift cluster from pluralsight but I don't understand anything. I need to learn redshift clusters in depth for a data engineering job. so please give me some solution.and please reply me 🙏

[Ravi_Teja_Padala_tAlKs]

I enjoy each and every video, learnt something new from you and keep going on your efforts @darshil and Thanks

[looklook]

I’m interested in signing up your data engineering class. Will pyspark and airflow be learned in the course? Will the projects involve pyspark or airflow?

[rayyanabdulwajid]

Hi Darshil. Is Pandas syntax necessary to remember for interviews? I'm asking because pandas also supports SQL syntax.