filmov
tv
Web scraping Amazon orders with Python and Selenium demo

Показать описание
A demo of the automated Python web scraper which gathers Amazon spending data from the UK site. Pay attention to the `&orderFilter=` and `&startIndex=` parameters in the URL bar. I've blurred out personal details of course, but you'll see how the scraper moves from year to year, and then page to page to scrape all of the order history data for analysis within the Jupyter Notebook.
0:00 Run Python code
0:21 Launches a Chrome browser controlled by Selenium
0:31 Waits 30 secs for you to manually log into Amazon
0:41 Scrapes Item Costs, Order IDs, and Order Dates
3:00 Repeats for each year in the year filter and each page in the pagination filter until finished
5:41 Analyse the data with Pandas