Scrape Any Website with AI Locally and Free - ScrapeGraphAI

This video shows how to install ScrapeGraphAI which is a web scraping python library that uses LLM and direct graph logic to create scraping pipelines for websites, documents and XML files.

#scrapeai #scrapegraphai

PLEASE FOLLOW ME:

RELATED VIDEOS:

All rights reserved © 2021 Fahd Mirza

[spencerfunk]

im building a rag system for a client right now and i think im going this. ive been using lang graph but i like how straight forward this is thank you for sharing, fahd

[polaroidsky]

May I make a recommendation? I think it would be better if you show what it does first and then show the install process. I came here trying to understand what this does and how it could be useful, but had to sift through the video to find that.

Other than that good video and thanks for the info!

[adriangpuiu]

can we have a more in depth example of using this lib ? IE : scrape pages from external file that contains multiple URLS without having to emmbed . this would be usefull for finetunning rather then using a KB embeeding

[NaveenChouhan-mmgz]

Hwy, I tried to install the scrapegraphai using pip, but the installation doesn't complete and it always return that the pkgutil is having an attribute error.
AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'?

[bomsbravo]

You are my favorite YouTuber now! I keep waiting until you give the news about some cool new AI tool.
I have question for you. I tried the story diffusion on my local machine and it has a Nvidia card of 16GB VRAM. But most of the times It never created anything but kept giving me an error. Do you think my Vram is not enough or could it be something else?

[Cosmos_comedy]

Can u scrape multiple websites at the same time? At large scale?

[ponsekhagurusamy]

Hi in output while executing generate answer processing chunks were strucked at 0% . How to resolve this. Why it was happening

[d.d.z.]

Nice video. How can I extract info from some querys I have to do to a website? I'm taking screenshots and then extracting the info using Claude but is not efficient or accurate, some suggestions?

[long龙龙]

Hello, can he crawl the website that needs to be logged in, and can he reduce the risk of being blocked IP, blocked account, and 403?

[junsheng-zwvu]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. how to fix it, ask for help

[medhajahl]

error : TypeError: __init__() got an unexpected keyword argument 'headless'