Python and Scrapy | Debugging a debugger | pudb & vscode

After a look at pudb I fix the debugger in VSCODE thanks to this article on stackoverflow. I thought I'd share this as it was one of those issues where the answer was obvious but knowing where to edit the settings wasn't.

Being able to step through your spider may be more useful with your custome Python rather than the Scrapy framework itself, but it's a useful tool to have, and also remember that you can set conditional breakpoints as well.

=== chapter timings ===

0:00 Intro
0:30 install pudb
03:35 pudb 2020.1 'A full screen, console based debugger'
10:27 Debugging using vscode
18:07 Python, Terminal, Execute in File Dir
22:24 Debugging with breakpoints

Python in VSCode: Set working directory to python file's path everytime:

Visit redandgreen blog for more Tutorials
=========================================

Subscribe to the YouTube Channel
=================================

Follow on Twitter - to get notified of new videos
=================================================

Buy Dr Pi a coffee (or Tea)

Proxies
=================================================
If you need a good, easy to use proxy, I was recommended this one, and having used ScraperAPI for a while I can vouch for them. If you were going to sign up anyway, then maybe you would be kind enough to use the link and the coupon code below?

You can also do a full working trial first as well, (unlike some other companies). The trial doesn't ask for any payment details either so all good! 👍

◼️ Coupon Code: DRPI10
(You can also get started with 1000 free API calls. No credit card required.)

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python

[samiullah]

I know it is off topic question. Is it possible to scrape emails from LinkedIn?