How to automate Web Scraping using Google Sheets

In this tutorial we would learn:

1. Automated web scraping through google sheets
2. Google sheet scripting

[davidrivera]

I really like how you take the time and explain everything in detail!

[DrGill.]

Excellent, .... U r excellent Made complex topics very God gifted quality

[rafaelsouza-ifco]

Man, thank u so much. I adapted ur code to my needs and now i have personal panel with information to work at stock/Reit markets. Thanks!!!

[ganpati]

Really helpful, I was able to do automate the task that I had to do manually before. Thanks a lot man you rockk!!

[schoolofstocks]

Your explanation is awesome. Thank you very much.

[lauracook]

Great presentation! But as I searched internet, ImportXML have search limit so is there a way around to bypass that limit? May be use importRegex? Also I was wondering if instead of editing the whole url in the string can we simply add those urls in spreadsheet and then reference those cells. Like have a helper column that will generate all urls using formulas and have a cell that will contain Xpath, this way we just have to reference 2 cells for each row.

[VataL_IND]

*plzz **_paste_** that script here so we can edit it and use it! plzzz*

[ganjarmuhammadnur]

thankyou very much. your tuotorial very helpful.

Man! That was an incredible explanation! Thank you!
I only have one question .. do you think it is possible to create code that we can extract tables from a website that requires a password and login to enter?

[twobitminer]

This really good thank you. Although a lot of the sites I tried this on, it didn't work. I got null back or error. Do you have a video where you go into this in more detail?

[christiangibbs.mp]

Thank you so much. For someone who has not done any programming, you made this very easy. I do have a question though:


When you complete the program, it wont update the times if there is already an input in for them. Do you have a solution for this? Instead of having to clear each entry and then running the program?

[lyndonhanzpernites]

It says "Could not import URL". I think Google intentionally made the function unusable to prevent web scraping.

[dishydez]

Hey, this was really good. Can I automate it in such a way that I can execute it for many different pages? Like a loop function?

[adiiliya]

Hi there,

i got an error just copying your instruction. on the script, it says on line 10 there is a Syntax error of such. I might be blind but what did i do wrong???


SyntaxError: Unexpected string (line 10, file "Code.gs")Dismiss

[stocktalk]

Sir how to automate data of stock market please guide me I am big fan of ur channel

[collinsm]

Really helpful tutorial! Thank you. Is it possible to also use this or a similar approach to parse date from pdf email attachments in gmail to populate a spread sheat?

[anjalisinha]

How can we make loop range dynamic, here we have fixed range from row 3-6 but it would be nice if that range is dynamic that depends on the last row of column A or Column C

[jyotik]

Thank You Sir. Very useful.. But can we make it auto streaming update with fraction of seconds automatically without any click button. I think may not be

[pasq]

Please share your sheet with everyone, it would be easier to reproduce
There is an error in line 13 var formula, could you past here the all line ?

[yashwanthermann]

Hi, i need help with Web scraping. I'm fairly aware of the sheets and the IMPORTXML function, but probably looking into more of this. Is there a way i can reach out to you and seek guidance ?