Web Scraping Using ChatGPT #openai #chatgpt #webscraping | extract data from website

#ChatGPT #OpenAI #webscraping

In this video , we will do web scraping using openai's chatGPT.
we will scrape data from a website and then export it into csv file using python and we will use chatGPT to generate this code for us.

Start: (0:00)
Target website: (0:10)
Asking ChatGPT to write code: (0:28)
Copy and paste code and run: (1:05)
Result: (1:16)
Modify our code: (1:30)
Updated result: (1:45)
Export data into CSV: (2:00)
Books .CSV file: (2:22)
Using utf8 encoding: (2:38)
Thank you: (3:04)

I built this Online Image converter tool using ChatGPT:

Make Money with ChatGPT - Build Online Tools website:

Make Money with ChatGPT - Build and Sell APIs:

AI made this Game:

Scrape Amazon Product Data using chatGPT:

Build and Publish VS code extension using ChatGPT:

Build a Website using ChatGPT in 1 minute:

Let's Run Breadth First Search Algorithm on the Internet using ChatGPT:

Build A Twitter Bot using ChatGPT and Twitter API:

How To Make Money using ChatGPT and KDP:

Build a Notepad App using ChatGPT:

Build a Web Browser using ChatGPT and Python:

Build a CSV to JSON converter using ChatGPT:

How to Pass Linkedin Skill assessment using ChatGPT:

ChatGPT in Top 15% on Linkedin JAvascript Assessment:

Build a QR Code generator using ChatGPT:

Build a Bricks Breaker Game using ChatGPT:

Build a Calculator App using ChatGPT:

Getting started with MidJourney and ChatGPT:

Build a To-Do List App using ChatGPT:

This Channel makes tutorial on how to access and use OpenAI ChatGPT.
Imagine being able to have a language conversation about anything with a computer. This is now possible and available to many people for the first time with ChatGPT.

[ChatGPT-AI]

Scrape Amazon Product Data using ChatGPT and Python:

[mycollegeshirt]

This is like when calculators were first invented

[JosephCodette]

I’m not scared of you at all, you’re my new coding buddy. Can’t wait for version 4 and better servers

[thebluriam]

Keep in mind the beautifulsoup library only works on non-dynamic pages which are fully loaded and do not use iframes; it would be better to call beautifulsoup a DOM parser than to say you are "scraping" with it. There are countless other limitations with the requests/beautifulsoup mechanisms; you will hit a capabilities wall very quickly.

If you want to do real web scraping, you need to be using something like Selenium which utilizes a real web browser driver and can interface with a live DOM environment in real time, operating against real DOM elements as well as being able to switch context to internal iframe elements and controlling things like the back and forward features of a browser as well as tabs.

If you are wanting to scrap a page which has dynamically loaded content, you need something like Selenium. It's a whole different beast but it's worth the time to learn (correctly)

[uffin]

The fact that you can have ChatGPT right code is so amazing to me, makes new concepts for code so much easier to figure out.

[roostertechchan]

This is valid only if the website hasn't changed layout after AI was trained. ChatGPT kept offering wrong code for a JS library, suggesting old version syntax.

[andrey]

To clarify - ChatGPT won't go to website and won't analyze it's html to scrape it.
It will only work if the site you're trying to parse were somehow part of library ChatGPT was trained on.

[mikebailey]

I love the fact that even the video narration is completely AI; from the wording, to the slightly uncanny speech synthesis itself. I bet the entire video was the result of someone typing-in a request to ChatGPT, to "write a script for a YouTube video which explains the use of ChatGPT to scrape websites". In the future, web dev may be more about developing the right questions to ask of AI...

[hippopotamus]

I've tried several websites and it guesses the web elements, GPTChat doesn't visit the URL and grab the source code so this is a bit pointless for most situations.

[klikz]

Fun fact the narrator and script is also ai generated. Jk I can’t even tell anymore

[toast]

ChatGPT create a video on how to creating a webscraper in python include script and video assets describe in detail

[BasharA]

Few years ago, knowing how to scrape used to be cool!

[jokwon]

And just like that thousands of web scraping software vendors cried out in terror

[seanthesheep]

I was expecting you to perform web scraping _inside_ ChatGPT, like, "Pretend that you are a terminal. Run my input as a command and respond only with the output in a code block. My first command is: `curl [URL to scrape here]`"

[adamcunningham]

The improper use of plurals is interesting. Is there some translation/ai reason behind this? I know that voice mimicry AI has also become quite impressive. Was this script passed through a translator, then through a text to speech generator?

[ghsnwdv]

straight and to the point, best tutorials hands down

[aimattant]

Thanks, I just scaled this up to a Firebase app for scraping and adding data into WordPress blog posts - love ChatGPT code help - woo

[okamotoshogo]

A new era of programming is dawning. We're about to be freed from the tedium of coding and able to focus on problem solving. .... or fired.

[mornepatterson]

Absolutely incredible. If you’re will to invest and spend time learning and playing around with this tech your opportunities are endless

[ProSound]

Not only this is about ChatGTP, but the whole video was produced using Chat GPT.