How To Use HEADERS in SCRAPY SHELL, Python Requests, and CURL - code examples

See how to add headers in the scrapy shell fetch command
and how to use cURL to check a URL via command line.

Make a get request with cURL to an API and got some JSON in the response

Links featured in the video :

Visit redandgreen blog for more Tutorials
=========================================

Subscribe to the YouTube Channel
=================================

Follow on Twitter - to get notified of new videos
=================================================

Buy Dr Pi a coffee (or Tea)

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python #arduino

[tomgreg]

Exactly what I was looking for....Thanks!

[mc]

Thank you so much! Exactly what I was looking for

[Semihszy]

can we reach the xhr requests that this URL makes when loading the page info? i want to scrape all the get requests of network/xhr and their URLs