Website Scraping with ChatGPT API (Python and Beautiful Soup 4)

00:00 Intro
06:23 Legal Comments on Copyright and Fair Use with AI
11:18 ChatGPT Pricing and Web Scraping
15:10 Getting the ChatGPT API Key
18:00 Why can’t you “just” submit an entire website to ChatGPT
27:36 Using Beautiful Soup 4 to Extract Text from a web page
35:44 Combining Beautiful Soup and ChatGPT API to Summarize a web page
45:00 Using ChatGPT to create tags for a web page
50:20 Final Thoughts

[Splarkszter]

Thank you for this!!!

Please people, this awesome person needs all the support we can give him!!!

[sat]

Love it -- Tks for the timeline. First 15:31 minutes was not needed since you should know all of this and if you dont its not "Eli" fault.

[abediop]

I sent the $5 I know it’s not much but I’m operating from a cardboard box lol. If I ever see more money in life I know who to thank !

[RJinD]

You've got AI asking you to verify you are human lol

[joeylaflamme]

Thanks for the tuts! Now I know how I'm gonna spend my weekend. Planning also to use it to feed a search engine like Elastic or Opensearch (probably more Opensearch).

[GeorgeLathem]

Wait Eli is back to teaching?! Oh how did I not know this?! OMG this is amazing news

[gileneusz]

all these copyright talks that you do in those videos making me really want to go to Asheville just to talk about copyright in AI, and I'll actually do it at some point. Hint, I'm from Poland 😅

[scotter]

When you say Python 3.10 is latest, do you mean for Mac or Linux? For PC it has been 3.11 for more than 8 months. FYI 3.11 has a noticeable speed increase over 3.10.

[armanigoabek]

28:24 web scraping is not that simple. Requests API might be enough for arstechnica, but for spotify it is not. Some sites use advanced fingerprinting, checking user agents and stuff to know that you are not scraper. In that case they provide you empty page, or redirect page. I think a workaround for that could be selenium, but .... I have not yet checked that.

[khalidfcaixeiro]

I am watching your arduino playlists for my recent project. Had you made any project with arduino in which we using bluetooth module and try to connect with other BLE sensor which also transmit data via bluetooth, also my question how can we pair with that sensor?

[ChristopherBruns-oo]

9:23 Even here in the states cyber identity laws are governed per state they're committed from I always thought.

13:43 I was tinkering with the gpt-4 model when it was new and racked up $95 charge in a single request (thread pools, it might of been more like 83 cause i had 12 previous and was 95 in total but insanely outrageous.)

53:01 some would argue artificial intelligence claiming a lack of natural intelligence.

[jakebaldwin]

The level of fun one can have once realizing what regex can bring all while confusing the uninitiated, so to speak. Anyone remember full stop? Yeah, tip of the proverbial iceberg IMO

[abediop]

I’ll send a few dollars you got me through a lot. God bless

[Griffen]

hi guys! at least let me have a personal chatGPT