Excel VBA Introduction Part 47.3 - Internet Explorer vs XML HTTP Request

By Andrew Gould

Replace TOURNAMENT-NAME with a specific tournament, e.g.

[shakmakbu]

Great tutorial and great presentation. This work is astonishing. I am watching your videos and learning. You are the best ever teacher I have ever met on youtube and must be the same in reality. Thank you so much

[Cosmologist]

Sir...You are a highly dedicated and committed teacher.
Thank You Very Much !!

[rjm]

Hi Andrew, I had been following since 2019 and your video has helped me a lot. For myself mostly but i am planning to use the knowledge i gained in future projects.

[beat]

Another superb tutorial.

I Would love to see a tutorial on how to get Data from Web Sockets into Excel.

Web Sockets are gaining in popularity for Real Time Data Analysis and you avoid any rate limits associated with Http / XML / REST API

[vulcanorosso]

Hi Andrew.... First I would like to thank you for the astonishing videos on VBA; think I watch almost all of them ...
I have a preoccupation related to apply the Scraping method especially for websites updating at the momment you are scrolling down.
I wrote a cod to scrap the Historical data on yahoo finance and if my time frame is over 1 year (like 3 years), I can only get the first year copied on my excel sheet.
I hope you could help me be able to download the remain data which are appearing on the page only when you scroll down.


Thanks again for your great Job

[pengliu]

Hi Andrew, at 09:12 you said HTMLDiv does not have Intellisense for getElementsByXX. In my opinion, that's because you are using the generic type IHTMLElement for any HTML tags. But since not all HTML elements have the same methods, Intellisense does not show the full list of methods (such as getElementsByXX). But if you use specific element types for different HTML elements, we will get the full list of Intellisense. For example, in your example, we can declare HTMLDiv as HTMLDivElement type. Then we will bring back methods getElementsByXX in Intellisense.

[KhalilYasser]

Thanks a lot for all the valuable videos

[Scooter]

Hi Andrew, thank you very much for your beautiful videos, I learned many things about VBA and I successfully create some projects based on your explanations. Now I have a question: I would like to grab a information in a page but I'll know its URL only after I inserted a search string in a textbox and I pressed a Go button, this in a previous page. This because a second URL is encrypted string and not contains what I've inserted in previous search string textbox reported in any url parameters. I have do all of that with IE libraries (not with XML libraries) adding a wait method into a sub, but now if IE is dead where I can use IE libraries? Is possible in other ways? Thanks anyway, bye from Italy.

[VincentHardwick]

Hi Andrew, me again. I wonder if your ever-growing list of video tutorial topics might include one for the MSXML2 library? Navigating around an XML DOMDocument, selection namespaces and XPath, and in particular, creating XML files from scratch using VBA. There seems to be a dearth of decent video tutorial content on these areas, and if anybody can remedy that, I believe you're the man for the job!

[garybenhart]

I changed the name of the name of the web site and the ScrapeOddsUsingIE code worked perfectly fine, although it was really, really slow (24 seconds). I couldn't get the ScrapeOddsUsingXMLHTTP code to work, however, and I'm relatively experienced with VBA. The XML code ran really fast (1 second), successfully adds a new worksheet and would never encounter any error, but the new worksheet will never contain any data from the web site table. So I'm not convinced that there is absolutely no difference between the IE version and the XML version (except performance).

[messirve]

Hi, just a small question: could you explain when a website is not able to scrape with XML HTTP, because not always ths method works for any site, isn't it? Thank you very much

[FistDaMonkey]

Hi Andrew, thanks for the tutorial. Do you have any plans for teaching how to use the acrobat add-ins to merge or sign pdfs and such?

[KhalilYasser]

When testing the code I got an error run-time error '91' at this line `Set HTMLTable = in the procedure `ScrapeOddsUsingIE`
I noticed that there is a popup offer when the page loads (I think this may be the problem) ..

[LuanNguyen-obzi]

Dear sir, please give us some lessons about upload & download files via FTP server using Excel VBA. Best regards.

[giuliko]

What an awesome lesson my friend. Congratulations. One question, what if we use post method? For example log into a website or fill any web form and then get the response? Please if you could make one more video going through this I appreciate very much. Thanks a lot.

[solankirishi]

Hello Andrew, I want to take out specific table ( just like Querytable) using xml http request. Will the keep the code running superquick vis a vis i don't have to get into the details of various loops (details such as "tr"/"td"/"th" etc required to get a specific table.

[ericnascimento]

When i write the same code that the Video uses, appears a warning message on the "XMLRequest.send" line, . it's written Access Denied. I can't figure out why this is happenning . Someone have any idea ?

[Ahmed]

hi, i found when i use doc.body.innerHTML = Req.responseText, the doc will contain only the <body > of the response, so if i try to get something from the <head> it didnt work,
is this how it works? what i can i do to access the head of the webpage. i tried doc.head.innerHTML = Req.responseText but it gave me error.

[thePrahoable]

Hi, can we use Google Chrome or Mozilla? Internet Explorer is too old and not supported by Microsoft anymore.

[mustafabakkal]

Andrew how can i parse an xml file in excel