Web Scraping With Python: Multiple Pages (Pagination)

This video covers Web Scraping multiple pages of content using BeautifulSoup4 and requests. I cover getting clues from the URL of different pages to be able to loop multiple pages to scrape.

[KhalilYasser]

Thank you very much. Just adjust the sound settings to make the video louder.

[isupport]

how can i plot, save to a file and perform basic statistics on each page?kindly help

[oumniaboudersa]

what if you click on the next button but the URL page does not change. how to handle that with Scrapy ?

[EdKingwaRd]

Great explanation, great video. I have a question, what if there is only 1 url and the table content changes as according to the table page? how should we modify the code?

[fahinrahman]

I followed so many ways but every time I parse through different pages, my dataframe only extrapolates the first page of the URL, EVEN when I explicitly only use only, for example, page_num=6. It always grabs the first page (page_num=1 table) even when I don't pass the link to the first page.

[carissarelleve]

Great vid. My next question is how cannit be transformed to database?

[thearmenianever]

Hello Alex
Thanks for the video, it really helped a lot!
could you please help me after scrapping the table how can we write the table in a CSV format?

[judetochukwuogbozor]

Please how do we handle a case if the different things under consideration(bedroom, toilets) has the same class and tag

[inspru]

Hi Alex do you have telegram or something we could talk and communicate I have some ideas to be created and if u could make it it be good for u and me as well