Web Scraping With C# - Craigslist Scraper Tutorial

In this tutorial, we will build a web scraper using C# and .Net Core. You will learn how to scrape craigslist listings for gigs in your city.

Resources:

#dotnet #webScraping #cSharp

[AustineMorgan-pf]

Loved the content! Do you think integrating HasData with this method would enhance the scraping process?

[alfiejones]

Awesome content! Is it possible to integrate HasData into this C scraping method for better results?

[BigDevax]

Hey! Don't know if you still respond to comments but I'm having an issue. When I try and change the link to something else like "services" or "for sale" on craigslist it doesn't work. I checked all of the title and description HTML stuff but it still doesn't work. I get an error within the link.

[zazo]

Hi! Awesome video. I was just wondering if you could use this for any other websites? I really loved this tutorial because its the first screenscraping thing I've ever done. You should make more tutorials on it, and P.S. Is there a way to use this on like youtube for like getting notifications? I dont know. Thanks! Edit: also nothings showing up in my pop up window/terminal. Im on windows and I copied your code exactly except for the '"stopAtEntry": true' part because when it was on false, my terminal couldn't launch.

[SuperHumanJeremiah]

Hi, I'm following your tutorial but at this point, 10:14 in your video, I run the program with breakpoint at same place, homePageLinks. I get no errors, but when I look at the output to the left of my screen like in yours, when see the List of homPage Links, it doesn't show a count of any links, it just shows a count = 0. So my question is whY? when I used the same link as you did in the tutorial.

[CellsAndRanges]

Hi, Good video. I'm trying to use external terminal as suggested, but the terminal opens and closes immediately hence not able to see the output. Any help will be great. Thanks.

[itscoulee]

On the debug menu I don't have anything in the configurations on the jason

[hvafornoo]

Hi there. Im wondering how you would use getSingleNode when a website isn't using sections, but only divs. How would you distinguish the div containing the description from another div, say the one right before the relevant one?

[jangronowski]

Is there any way to make the web scraper click a button?

[MrPodgikins]

Thanks so much for this - you've done a great job at presenting this. I am getting duplicate entries though and after debugging my code I cannot tell where it's coming from. I have the same as you've done. Hmmmm.

[lightsora]

if i have to use to another site wich cssselect is not the same what i have to put in cssselect(" ") ?

[abdulshakoor]

how we can get login before data scraping kindly help me

[moreno]

Hi, thanks for this video, but i cant find the Scraper.dll or how can i create them ?

[BomMeldingYT]

Okay, can you help me to make a really good scraper (paid) to scrape on a particular site?