RPA Software Docs: How to use Visual UI Testing and elementFromPoint (#efp) to click on an image

This video has no sound. It shows a two line web macro. The first line finds the image (in this case the "heart" of the Instagram like button) and the second command uses elementFromPoint to get the locator of the button and click it.

The visual UI testing commands allows you to write automated visual tests with UI.Vision RPA - this makes it the first and only Chrome and Firefox extension (and Selenium IDE) that has "👁👁 eyes". A huge benefit of doing visual tests is that you are not just checking one element or two elements at a time, you’re checking a whole section or page in one visual assertion.

The coordinates of the center of the best found match are available in the internal variables !imageX and !imageY. Together with the elementFromPoint (x,y) function of the web browser, you can find out which element (locator) is at the image, and then use this locator as input for all commands that take a locator as input. For the most common use of elementFromPoint with the !imageX/Y we introduced a shortcut notation of just using #efp, which of course e-f-p stands for e_lement_f_rom_p_oint.

PS: We are not affiliated with the Instagram account shown in the video, this is just a random pick.