Web scraping & task queues with Flask - Learning Flask series Pt. 22

In this video, we'll setup a task queue to scrape some data from a URL using Python's BeautifulSoup library.

[bryce]

“Pip is lit”😂 Appreciate these tutorials mate, good work

[EzequielTejerina]

Julian, excelent job with this tutorial. I´d like to know if there is a way for the rq (Worker) to trigger an event when the jobs are done. Thanks!

[loztagain]

Love this Julian. Using basically just this I have built a flask app that listens for webhooks from another program, and then updates some info in a custom field in that program (i have no control over that program, but it does allow for webhooks, and has an API interface that accepts updates)
AND just so you know, I am basically a noob at python. Which means your instructions were pretty clear! Nice one

[abdulqadir]

Great Explanation! just wondering how can we update UI once Queue or job completes

[ataimebenson]

Is there a way to halt the execution of the remaining flask script till the Jobs in queue are done ?

[attentiondeficitdisorder]

Amazing. Just made my life worlds easier. Thanks for this.

[gabriel_felippe]

Great tutorial! Thank you Julian <3

[nouralbibi]

Thanks for the great and useful video. Actually, I am encountering a problem with installing Redis on my laptop it has Windows 10 OS. I tried to use the WSL tool but not worked to me. can you please advise me regarding this

[torstenschindler]

How to stop background jobs and how to run background jobs for tasks requiring OAuth2 authentication?

[ranger]

how do i view bg_process progress status in front-end?

[sayhellotoroy]

Why do I need redis for this task? if it just runs a method then sleeps. Can I do the same with threading.Thread ?

[legttv]

The background music goes so great with the video

[EricSouzarys]

Hey, thanks for the video, excelent content!
I am trying to use async tasks but also neeed to save data to database, but I got this error: "RuntimeError: No application found. Either work inside a view function or push an application context". Do you have any ideia about this? All other think done inside the task, only the database part fails

[tariqkhasawneh]

Can we do the same thing but using a selenium script instead of beautiful soup?

[amirmaaoui]

it will be better if you remove your video musical background which is disturbing

[ioooozo]

ModuleNotFoundError: No module named 'app.tasks'
Stuck at this, structure the same

[duhangunsel]

What can I use instead of 'fork' in windows? Or do I just need to work on linux?