Web Scraping Made Easy Using this Method.

Sometimes it is that easy - check for the websites API and make a curl request, you might find its open and available! this video shows how to check, grab and export such data.

[OfficialMazLi]

I learned this trick in one of your older videos, it saved me a lot of times, i even made a discord bot using a website api by doing this trick, pretty useful. Thanks for the great content sir.

[letsexplore]

You are providing very valuable materials to community thanks

[graczew]

Good stuff as always. Maybe you should do something from devops site of scraping. Maybe how to automate/schedule your scrapers on virtual machines etc?

[AhmadRaza-rhpg]

Hello John, I am doing web scraping of an e-commerce website using its backend APIs. When I check the browser's network tab, the API returns data, but when I use it in Python requests with the same cookies and headers, the server doesn't respond correctly and doesn't return data.

[pypypy]

As always, excellent stuff. On 7:27 i would add a parameter indent=4

[brute]

what is the point of scraping if they give you an api to use??

[alfakih]

Hey champ, please share more real world project

[paradix]

I'm getting a 403 when calling the request URL :(
Any idea how to go about it?

[AmodeusR]

Could you tell me the name of the theme you're using in your IDE? Thank you in advance

[mkgjpco]

sir, i am from india, please could you tell me, why does not allowed some website fetch and xhr in network of inspect

[killianrak]

Hey
I’m trying to scrap vinted API unfortunately there’s delay between the data is created and sent to me

I have good connection so It’s not because of my network

Some people success to bypass this delay but I don’t know how do they do

Have anyone any idea of how can we bypass this delay ?

[uygarsaroglu]

hello, I want to extract the data of the traders on the bingx site. But I can't get the data. Can you help please.

[humansaremortal]

Have you tried scraping the dark web?
I have a friend do some scrapping for his master thesis and god lord, everything is slow and it breaks.

I don't know how to go around it.