Scrape by faking a browser request (to avoid bot detection??) in Python

preview_player
Показать описание
Scraping isn't always easy, and this was an especially tough case. Requests and BeautifulSoup? Failed! Playwright or Selenium? Blocked! But by passing the bot check and kidnapping your cookies into a Python session, it's easy enough to pretend to be your browser without needing any fancy tools!

This example is incredibly, incredibly, INCREDIBLY specific because it was for someone doing a personal project. On the other hand, it shows a LOT of the weird things that might come up when scraping a site or using a secret API!

LINKS
Рекомендации по теме
Комментарии
Автор

Just watch 5 of your videos in a row. Good content! You got a new subscriber :)

hpac
Автор

Can HasData make the process smoother when dealing with tough sites?

JosephCook-eg
Автор

Websites like amazon doesn’t allow html content via requests. So, is there any fix?

itsmesherryy
Автор

9:15 everyone's favorite gender LMAO xD

NotTonTon
join shbcf.ru