Python Web Scraping Tutorial 12– Crawling and collecting data

preview_player
Показать описание
In order to make web crawlers useful, we need to be able to do something on the page while we're there. Let's look at how to build a scraper that collects some data on the page we are traversing.

------

----

----
Schedule: New educational videos every week
-----

Learn Something New:
------
-----
Learn Something New:
------
Рекомендации по теме
Комментарии
Автор

Let's start to collect data with our Python crawler :-)

karramsos
Автор

I like your steps too.. Its a good learning technique

jumarashid
Автор

I think for editing portion of a specific article page, it's no more "ca-edit" now, it's now seen as "ca-viewsource". what "Edit" used to be is now actually "View source". Hence I guess it should be "li#ca-viewsource -> a"

kazimehrabrashid
Автор

Hey Sukhvinder Singh, I have an error.
On this line:
print("Edit link:", bsObj.find(id =

Debug Console:
File "c:\Users\KKTHNXBAI\Documents\Python\manchester_scrape_newlinks_only.py", line 12
print("Edit link:", bsObj.find(id =
^
SyntaxError: invalid syntax

Wondering if you could help me, much appreciated.

amirshaw