GO for Beginners - Web Scraping with Golang Tutorial

In this golang video tutorial I will guide you through an excellent example of a beginner project for those who have started learning GO. This basic HTML web scraper will introduce you to some of the GO fundamentals, and also hopefully make a slight more interesting project that you can use to expand your GO skills.

-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
-------------------------------------

[rouabahoussama]

Hey great work,
Actually there is zero values for fields in the struct so you don't have to specify all the fields values if you don't have it.

for example :

type Item struct {
Name string
Price string
]

func main() {
item := Item{Name: "John"}
fmt.Printf("%+v\n", item)
}

try it and let me know what you have learned.

[MOriginal]

Best guide for web scraping on the internet!!! God bless you mate. Because of you I've been able to start so many projects that I was scared of starting because I thought web scraping was too complex. But you simplified so many things for me

[anisarebecca]

Great video, John, thank you! You strike a perfect balance of moving at a good pace but clearly explaining what you're doing.

[harkirehal]

This is the way to learn a new language. Simple, concise programs. Great video!

[hsider]

I've already been familiar with Golang syntax but coded interesting with until today, wow, the speed and simplicity of Golang plus this library that comes packed with all the features I need for scrapping, amazing discovery, I don't think I'm going back to python for this kind of projects. Nice video mate as always 👌

[realB]

At 11:30 it start to get really interesting when the Colly Framework starts auto-navigating to different pages. However, the details for doing so might not be that obvious for beginners like me (tooke me some minutes) and could have been explored in a bit more detail and length. All in all, great vid. Have learned a lot in no time!!

[lamhintai]

Great content as always! I’m pleasantly surprised that you are covering new languages, as I really like your succinct style of presentation. I have always heard of the good things about Golang but had an impression that it’s mostly for web backend stuffs. Your video sparks my interest to actually pick it up now!

[comfixit]

I really like how you present the information and structure your videos. Would you ever consider doing a video on how you prep to make videos?

[cryptojunkie]

Great content, John. Seems Go/colly will make things easier for the personal project I've been working since I first thought about trying scraping a couple of months ago. Just as I'd managed to get what i needed from python following your vids and adapting the process for the site I'm wanting data from, and others code i'd found online, to work for the most part. Certainly getting the url's i need to be able dive in further was a lot easier with Go.

[mujeebishaque]

Please do a comparrison of speed between Python and Golang Thank you. Love your content. I hit the like button first and watch later, top quality content as always.

[thisguyisnotable]

awesome tutorial, really enjoyable to follow along! thanks, you earned a sub!

[mjacfardk]

Thank you brother.
As always great content from great mind.
Keep going brother 🤗.

[mondesinxi]

Great walk-through! I used this to get a web-scraper going. I had done some web scraping with Python using selenium to get product info for a local supermarket chain, the code was much longer and getting it working was a lot more involved. It would probably have been neater with Scrapy. Anyway, this makes for a nice Part 1 of a mini-project. Part 2 would be to get your data into a database, sqlite as a start. Finally, Part three would create a RESTful API to expose your scraped data.

[janisvelbergs]

Hi John,

This was great content! Go with Go ;)

[dwiatmokopurbosakti]

good content man, please do more scraping with go especially on dynamic website, ty so much

[valuetraveler]

Much easier to get started than Scrapy used to be . General comment - such FWs are good for structured sites but what do you think about where there are no next links and no sitemap?

[Danny]

This is an excellent tutorial, John,

At the end of your demonstration you mentioned about using it in a Proxy. I found that intriguing, could you please elaborate on this, or if you know any tutorial online that I can read on would be great,

Cheers.

[David-mjst]

I am learning your python videos, I need to keep the pace, haha!

[salimbo]

A lot of people are learning go But I keep googling rust libraries LOL. My history is full of "rust rest api framework", "rust web scraping library", "rust machine learning library".

[dpljs]

Really good work, exactly what I was searching. Also, what color schema do you use?