Python Code Review: Adding Pytest Tests to an Existing Python Web Scraper

This is a Python code review I did for Sunny's web scraping project on GitHub.

In this episode you'll see Flake8 and Python code linting tools make a comeback. Also I'm doing an intro to adding Pytest unit tests to an existing Python code base in the second half of the video.

As with the other videos in this series, I left the video completely unedited. That’s why I’m calling this series Code Review: Unplugged. It’s definitely not a polished tutorial or course. But based on the feedback I got so far that seems to be part of the appeal :D

* * *

FREE Python Tutorials & News:

[kbabioch]

Really great series, its always helpful to see the real-life workflow of others. Very much appreciating.

[coreyhermanson]

This was incredible. Didn't realize how much I would learn by watching an expert Pythonista refactor code that's about at the level I would write. Thanks so much for all your work and effort, Dan!

[sunnz]

Thank you so much Daniel, I have just watched the whole video and really grateful that you have picked up all the things and run through writing test, thank you! One thing that jumped out for me was how you wrapped that 2 lines of yaml in your test script with brackets. I like how you can learn these little things helps in a long way by watching someone writing code. There are a lot of things to go through (which is a good thing! 😄) so I will have to write back via email and pull request on github. Thanks again for the review it helps a lot to get to know where to go from where I am at!

[gunnarrudovics]

Thank you for your work. It was helpful to me when im now trying to get into TDD

[lokeshk]

How to get process id(gw0) using worker_id??

[shivamanand]

Watched the video wondering wow who is this guy, , , real python! Figures =)