Python SEO Concurrent URL Fetching

preview_player
Показать описание
Got some time on your hands? Looking to develop some assets that can't be taken away from you? Invest in yourself and LEARN PYTHON! Jump in head-first into a somewhat advanced project where I talk about one of Python's most annoying characteristics: it's darn unusual concurrency / parallelism / non-blocking I/O whatevers... because in Python, it's all on the table. You're not locked into a web-centric web-programming model and particular interpretation of these issues as you are with JavaScript. Instead, you pick your concurrency poison, and in this video I pick mine: grequests. So join me as I extract a URL-processing and site-crawling subroutine out of an existing project, create a new github repo for it and write the concurrent URL-fetching function. If I'm so-motivated, I may re-write my website crawler function, which I am also extracting from a prior project so as to create the original set of URLs to fetch. Very meta. But only Python-meta. Not LISP-meta. It's just the right amount of meta for me.
Рекомендации по теме
Комментарии
Автор

That's strange, I've had to use chrome 48ish if I want to use bs4 for scraping Google. Unless I use selenium web driver, because any version in the mid 50's and above I'm getting an empty list back in my response. Dude the sound is better now by the way!

leonlysak
welcome to shbcf.ru