Scraping a JSON response with Scrapy | Fxing Subscriber's Python Code for ratemds

Scraping a JSON javascript response with a Scrapy Spider

In this video I help a subscriber who was getting "None" with his selectors.
I modified the Python/Scrapy code to get the elements he needed using:

reference:

#scrapy #selectors #xpath #css #python

Download/Clone my code at :

⚠ Disclaimer : Any code provided in this tutorial is for educational use only, I am not responsible for what you do with it. ⚠

See you around yeah?
Dr Pi.

[aarons]

Read the code and interesting use of the script tag! I hadn't seen json data like that within the script tags.
Also looking at your code I love this
try:
os.remove('results.csv')
except OSError:
pass
Simple and useful!
Should have something to say on Json myself soon! Watch this space. Hope you're doing well, love these videos.