Web Scraping With Python 101

Web Scraping With Python 101

"Clean Code Friday"

Follow me on:

--------------------------------------------------------------------------------------------------------
GEAR:

[Hallden_]

I was first going to just grab the title of a video and utilize the .text method of find_element_by_xpath method. But felt it was not as interesting as clicking on a video. So for the people saying that this is ”not web scraping”, technichally they are right since I am not extracting data from a site. But, doing that would look exactly the same except instead of using .click() you would end it with .text. (You would also need to get the title element from the YouTube page). So for the purpuses of getting someone started from zero knowledge to being able to start doing web scraping, this difference is not important :)

[erozionzeall]

What video was supposed to be: Webscraping with Python
What the video actually was:
Roasting windows

[Yugo_Doom_Scroller]

Him: my desires are unconventional
Her: show me
Him: *runs the python script*

[cyberdash]

0:04 good heavens, what even was that

[seanobbb]

i've done quite a bit of web scraping in c# and python, but man you just made my life so much easier showing how to copy the xpath in chrome.

[jonathansgarden]

"I certainly do" in the beginning made me subscribe immediately. Weird humor is the best.

[preyes]

When using Vim with a dark terminal background, add "set bg=dark" to your ~/vimrc file. You can also just set it temporarily by typing ":set bg=dark" (without quotes) in Vim when in normal mode (not in insert mode). This will make colorized text a whole lot easier to read.

[Zydres_Impaler]

UPDATE:
In recent updates; is deprecated
instead use;

browser.find_element( 'xpath', path)

[rickr]

There was no Web Scraping. This was literally just setting up selenium

[BoloBit]

knowledge of python: "Check." Knowledge of web scraping:" I certainly do." hahaha that made me laugh like Muttley (aka a wheezy snicker)

[TheWindsofWonder]

0:04 I absolutely love when you do something that I wouldn't expect you to do lol. I just know this channel is going to blow up!

[adrianchong]

You should use Powershell on Windows and forget about the old school MS-DOS Command Prompt.

cd into the directory desired

To Create File
ni .\webscraper.py

To Open file
ii .\webscraper.py

ni : alias for the New-Item command
ii : alias for Invoke-Item command

Nice video. Keep it up!

[eliotportevin]

This has just given me sooo many ideas on how I could annoy everyone I know

[damjanzimbakov]

This, hacking wifi passwords, hacking into a car and a lot more are videos that inspire so many young teenagers to start programming.
Nice job.

[xixReact]

hope you're having a good day Kalle

[stevediks]

I have actually made a project which keeps checking if any reservation slots pop-up/come free at my closest gym because it is almost always completely reserved. This way I will be the first one to reserve an upcoming free slot when someone deregisters.

[JacksonWelch]

Video quality has improved 1000x in the last year. Great stuff

[webslinger]

You can also do this using UiPath. It has GUI and the community version is free. Then dump the info into an excel file. Some knowledge on VB and C# needed for more advanced options.

[royz_]

Webscraping 101: always try to identify an element with an id first

[joaoparis]

"opening files in windows sucks"
*googles how to open files in windows*
"windows actually has the simpler way of opening files"
😂😂😂

Maybe we are too hard on windows 😅