Async & Await in Python Simple & FAST HTTP Requests

Code:

00:00 Explanation and Goals
02:07 Code
07:46 Why ASYNC?
08:43 Expanding

[PerScientiaAdAstra]

...if throughput is not an issue for you but stealth is, or perhaps you can't afford a proxy, and you have a good 4G/5G cellular account then you can tether your PC. Each time you toggle flight mode the cells public IP changes. You might even be able to write a script to periodically toggle flight mode when required. Also if your fixed line has a dynamic IP then, by definition, this will also work by toggling the power of your router, but the cycle time is much slower. Btw, great work as usual John.

[gotenksjd]

Very nice video John! I'm just learning how to include async in my first code. It would be incredible to see an exercise in more protected pages like Expedia!

[mehrdadanvar]

Look how similar it is to the async and await in javascript. At some point during my projects, I had to turn to javascript cause the asyncio and co-routines were a bit difficult for me! Just like always, it was great content, very specific, and worth 1000 likes and comments.

[robertarends]

Thank the lord for this guy. He just saved me days of work

[ameurchabane]

Thank you rooney for your support, what if the urls does not change it means we have the same url but the response will change by variable parameters, i tryed this : make list of the url in lenth of our parameters("pages") : resp= await client.get(url, params, headers)

[adnanpramudio]

That thinkpad tho, I see you're man of culture as well

[jamieosh]

Finishing off with showing how to use IPRoyal and it’s impact would have been nice.

Your typing has got a *little* better 😂

[loverboykimi]

What is the difference between async and threadpool ?

[JackJones-eddx]

Hey John, is there any way to be able to scrape a site that has a list of products for example in which you scrape their links and title. save the title and then go onto crawl the link?
Would very much appreciate any help or maybe a video follow up!
your channel has been great so far, thanks for everything!

[irfanshaikh]

Looking at this, thinking of writing a code that'll create tonns of gmail accounts, each entering YouTube and subscribing this channel.
Hopefully thay can be done using asyncio 😜
Thanks anyways John

[jimmyboy]

Hello, Can you please tell me which python module use to scrape cloudflare protected site's?? I used splash for that... But it's not working now .. bot protection is active... User-agent doesn't help either...

[ManiS-prui]

Hi John
How can you convert this to ASYNC requests. I have urls in list

For url in urls:
r=request.get(url=url, header=header, verify=False)
Data=r.json()
If data[code]=200:
Df=pd.normalize(data['data'])
Df.to_csv(test.txt)

[BathingAfrican]

Lmao I be liking the video before opening the app smh