How to Scrape Websites Without Code | The Ultimate Tutorial

❗️Update
Just a quick heads up for those following this tutorial on Bardeen AI's web scraping capabilities! 🚀 There have been a few updates to the UI since this video was posted:

1️⃣ The action name has changed from "Scrape Data on One Or More URLs" to "Scrape data in the background" for scraping data from a list of links in the background.

2️⃣ No need to use the "find all links in text" action anymore to make the background scraper action work. 👍

🤖 About Bardeen
Bardeen is an automation app to replace your repetitive tasks with a single shortcut and control your web apps from anywhere. Explore our integrations with your favorite apps and hundreds of pre-built playbooks that help you stay in the flow!

🔍️ Explore Playbooks

ℹ️ Need help? Join our Slack community

📖 Video Chapters:
0:00 - Intro
0:21 - Fundamentals of web scraping
1:37 - How to build automations with scraper
6:03 - Deep scraper
10:26 - Data enrichment
12:44 - Closing notes

[alachuahouse]

Great product! I was able to extract property management company info from Zillow's list of active properties for rent buy doing a deep scan! What a time and life saver. Since I don't have any developer experience, I had to watch this video like 4 times and finally it worked. thank you!

[Bardeenai]

*We've just released the updated, more comprehensive scraper tutorial!*

What's new exactly?
- Advanced Scraping
- Triggering Scraper With The Right-Click
- Background Scraping
And much more.

[Bardeenai]

*Just a quick heads up for those following this tutorial on Bardeen AI's web scraping capabilities!*

There have been a few updates to the UI since this video was posted:

The action name has changed from "Scrape Data on One Or More URLs" to "Scrape data in the background" for scraping data from a list of links in the background.

No need to use the "find all links in text" action anymore to make the background scraper action work.



Happy scraping, everyone! Keep up the great work with Bardeen AI!

[AIenthusiast]

damn this is crazy, I was able to do this with linked in groups data scrapping, thanks a lot, will now do this to get a list of potential clients to contact

[influenceink]

How does Bardeen manage cloudflare, IP rotation, and anti bot systems?

[lvcfer]

Hi guys. As a customer, I highly suggest you make an updated video based on how Bardeen UI has changed. There are definitely a decent amount of UI changes, options, text, button placements, etc. as of speak (April 28th, 2023).

This is way too outdated for new users. Please kindly make a refresh video. Thank you!

[krom]

Can you do a deep scrape tutorial for zillow and redfin. please!

[vgcptmz]

This guide must be outdated. I followed it step by step. The interface looks different and in the end I am unable to deep scrape. The scraper is totally disregarding step #2 in the automation.

[SebastianMont-bioh]

can i use this with different proxys and anti detect softwares

[andronautic]

Great stuff. But for now we et only the scraping content tools you showed I'd be interested in scrpping details as page title, favicon and logo links, address from footer, etc

[TypicalTamilans]

I noticed the tutorial that provides the facility to do deep scrape if we can get the links using the table scrape as first step and then do page scrape using the links from first step.

I want to know what to do if we can't get a link and the new page opens as a popup in the fist page.

[ikebaldwin]

Did the scrape on one or more urls option disappear? It is not showing on my sheet

[lvcfer]

Does Bardeen support "add data to a particular column"?

I'm using 2 playbooks with 2 scrapers.

1. Scrape YouTuber's profile name + link -> add a new row to Google Sheet

I then used =CONCAT to add "/about" to the link column so I can access Youtuber's profile page with ease

2. Scrape email from a YouTuber's profile page (/about) -> add a new row to Google Sheet

Have to pass the captcha manually.

The problem is that the 2nd action creates a duplicate row with those in the 1st one.
If we have such action as "add data to a particular column", then it can potentially get rid of the duplicates.

[peterkingston]

Does Bardeen manage cloudflare, IP rotation, and anti bot systems?

[kanwalkaur]

I was trying to scrape a website in which I need to extract store details from store directory, which has multilevel navigation. So, I was using deep scraper as you have shown, but Scrape Data On One or More URLs option is not showing in my playbook, any suggestions.

[lvcfer]

great video. I'm trying to scrape YouTubers' business emails from a search result on Playboard. Would Bardeen be able to do that?

[chinoisdope]

Hey there great video. I have a question. I tried to scrape followers from a specific instagram user. The extension extracted 49 list, but each list had the same users in the list. Not sure where i went wrong. I used infinite scroll. Is there something that i missed? TIA

[MikelUrbietasuperurbi]

I'm lacking a feature that allows me to grab all the data of a table from the page scrape option. Just a way to grab data fast without clicking in each row of the table.

[rickyventaglio]

hey - this video is a bit outdated compared to the new update of the extension. Also, If the webpage does not have a list structure within the source code, the extension will struggle to operate. Just an FYI

[IoannisMaras]

Hey, I was wondering how can I keep some rows of my table depending on some conditions