Python Web Crawler Tutorial - 11 - Crawling Pages

[afdsadf]

"I have this box of tissues next to my computer" - bucky

[svedalawoodcrafts]

LOL. I needed to know that, thx :) (Must view video to understand the comment)

[sachinifernando]

if I want to get the URLs that belong to a specific class instead of getting all URLs. how should I change the code?

[marryamsaad]

how to crawl only a set of links retrieved by google d\search api in python

[alexqiu]

Great tutorial! I don't get the last step which updates the file. Can we just let all spiders work on the same set, and update the file from the set when all of them are finished?

[Naveen-bscq]

Line 41 : Spider.update_files() is not thread safe. When multiple worker threads execute this concurrently wouldn't some race condition happen? Will this not happen in practice because of GIL??

[johnmaxwell]

I'm not getting "threadname" in intellisense ?

[thomasip]

Bucky when do I use " and when do I use ' ?

[Tamal]

You waste SOOOO MUCH time not getting to the point