Python, NoSQL & FastAPI Tutorial: Web Scraping on a Schedule

Python, NoSQL & FastAPI Tutorial: Web Scraping on a Schedule

In this series you'll learn how to:
- Integrate Cassandra with Python, FastAPI, & Celery
- Setup & Configure Astra DB (managed cassandra db)
- Schedule & Offload Tasks with Celery
- Web Scraping Techniques
- Selenium & requests-html to extract & parse data

Links

0:00:00 Welcome
00:00:58 Demo
00:12:58 Overview & Requirements
00:15:22 Project Setup
00:19:26 Start the Python & Cassandra Integration
00:25:11 Configure Python cassandra-driver
00:30:13 Your First Cassandra Model
00:36:08 Create Data using our Cassandra Model
00:43:20 Adding a New Column to an Existing Model
00:46:26 Using UUID1 as Primary Key
00:55:19 Using Jupyter with Cassandra Models
01:06:35 Using Pydantic for Data Validation and Cleaning
01:14:22 FastAPI & Environment Variables
01:21:26 FastAPI + Cassandra & Pydantic
01:36:01 Convert Cassandra UUID Field to Pydantic Datetime Strv
01:44:50 Endpoint to Ingest Data for FastAPI & AstraDB
01:56:41 Celery, Redis & Basic Task Offload
02:13:18 Integrate Cassandra Driver with Celery
02:23:47 Running Periodic Tasks
02:35:24 Basic Scraping with Selenium
02:45:35 Selenium & JavaScript Endless Scrolling
02:52:52 requests-html & Parsing Data
03:11:34 Implement the Scrape Client Parser
03:27:20 Putting it all together
03:36:58 Thank you

[CodingEntrepreneurs]

0:00:00 Welcome
00:00:58 Demo
00:12:58 Overview & Requirements
00:15:22 Project Setup
00:19:26 Start the Python & Cassandra Integration
00:25:11 Configure Python cassandra-driver
00:30:13 Your First Cassandra Model
00:36:08 Create Data using our Cassandra Model
00:43:20 Adding a New Column to an Existing Model
00:46:26 Using UUID1 as Primary Key
00:55:19 Using Jupyter with Cassandra Models
01:06:35 Using Pydantic for Data Validation and Cleaning
01:14:22 FastAPI & Environment Variables
01:21:26 FastAPI + Cassandra & Pydantic
01:36:01 Convert Cassandra UUID Field to Pydantic Datetime Strv
01:44:50 Endpoint to Ingest Data for FastAPI & AstraDB
01:56:41 Celery, Redis & Basic Task Offload
02:13:18 Integrate Cassandra Driver with Celery
02:23:47 Running Periodic Tasks
02:35:24 Basic Scraping with Selenium
02:45:35 Selenium & JavaScript Endless Scrolling
02:52:52 requests-html & Parsing Data
03:11:34 Implement the Scrape Client Parser
03:27:20 Putting it all together
03:36:58 Thank you

[darkkrad]

Justin you are one of the most amazing persons on the internet. My respect for you is immense. The way you explain in such a lucid language and with so much command over the topic... Incredible. Wish we had teachers like you in school and college. I'm a big fan. I learnt Django from your course. I'm so grateful for your videos. Thank you!!

[konstantink]

I really like how you split such a long tutorial for short parts. Especially, this music transition really draws my attention back. Love this beat, amazing job!

[wcdev]

This is pure gold dude, also breaking it up on phases.

[ericbroun]

سلام بسیار عالی ممنون از زحمت شما امیدوارم که همواره موفق باشید

[codetrap]

Hey Justin I'm from India and I start recently watching your videos.your videos are amazing love from India.🙂

[hayat_soft_skills]

Awesome! it's my wish to learn more from you. Thanks!

[edinhofilho]

I had some issues with Apple's new architecture, like some dependencies and packages on different architecture.
But the tutorial is insane, thanks

[anthonydattolo]

Really cool. Would be interesting to see how FastAPI holds up vs DRF for stuff like jwt authentication flows. In DRF it’s simple you just import some libraries that handle the heavy lifting

[nateriver]

Hey! Thank you so much! Can you show an example how to scrape AJAX pagination with selenium?

[asalvats]

About the UUID1 datetime : that day 'started' the gregorian (current) calendar. BTW, thanks for this great tutorial !!!

[nateriver]

Amazing tutotial, except the music between chapters ))

[official.letsfeellove]

Hello sir i really love your Videos. Sir i can't solve django rest framework email verification and reset password problem. Can you please help us about it?

[bumblebeeable]

Hi, Could you please advise me some online/pdf book to learn FastAPI along with Cassandra? Thanks so much.

[skyblaze]

Why can't django use fastapi compare to flask ?

[thecodingchronicles]

@CodingEntrepreneurs is there a easy way fixing issue on mac M1 with how creds are extracded from zip into temporary folder?

[vincentle]

It would be supberb if you could provide an alternative for Celery because Celery seems to be not working on Windows. I had to stop following the video because I couldn't make it work. But thanks a lot, the other things helped me big time

[adesegunkoiki]

Please how do i drop a table if i made an error

[sahil_singhai]

Hey how do I delete all that Old data from the DB?

[pravarsharma]

How can we store large file on NoSQL dbs as in mongodb we can only have a Document size limit to 16Mb, is cassandra have some kind of limit