UI Automation in Power Automate for Desktop (Full Tutorial)

This video tutorial shows how to do UI Automation in Power Automate for Desktop. Using drag-n-drop and no code, it's easy to click buttons, fill in text, and extract data from the applications. The advanced part of the tutorial demonstrates how to create dynamic selectors.

COURSE MATERIALS:

VIDEOS FOR YOU:

- Join my network with 2800+ RPA Developers, where we solve RPA problems, network, and help each other upgrade our careers. It's free!

FOLLOW ME:

MY MONITOR (Amazon affiliate):

0:00 Intro

1:37 Open Application in Power Automate for Desktop
The Run application action needs to be used to open an application in Power Automate for desktop. First, fill in the Application path.

2:17 Close Application
Use the Terminate process action to close all instances of an application.

5:25 Click UI element in window
To click a button in an application the Click UI element in window action is used. Find the button in your application and press Ctrl + the left mouse button. It's best practice to rename the UI elements to make the process easier to maintain and update.

6:26 Create a Dynamic Selector
Dynamic selectors are very powerful, as they allow us to move away from a static solution. We use a variable in the selector.

10:58 Extract data from window
The Extract data from a window is used to extract data from a window. Create a UI element, and the result will be stored in a variable.

12:48 Get subtext
Use the Get subtext action to manipulate text and get a part of the text. Remember that the character position is zero-indexed.

#office365 #powerautomate #microsoft

[andersjensenorg]

Is this video helping you? 😊 You can help me a lot, by then giving it a thumbs up 👍 Thank you. Kind regards, Anders

[engineerjunaid]

Brilliant teacher Brilliant method Thanks for such amazing tutorials

[ASO-xhvu]

New subscriber. You are the only person who takes educating people in this software seriously. The is absolutely no serious content about this that is consistent. Please make more content about Power Automate. Thank you so much Anders!

[brucekleine]

Thank you Anders for your step by step tutorial. Very helpful!

[dpwood]

Quick and easy! Really enjoyed this one.

[markjudeestrera]

Thank you Anders new subscriber. Very concise and well explained.

[ALVINMAN]

Very good Quality. Great Video. Thank you.

[LapaConsult_Ex_Macraris]

Thank You! this video help consolidating basis of UI

[sazzarello]

Excellent Video! I have spent alot of time developing my Excel Power Query skills with Leila Gharani, but I wanted to see what this Power Automate can do or me. I have followed along to a number of your YouTube videos and am very satisfied with your ability to teach these concepts. TY for sharing! You are the number one in this area on YouTube.

[thepragmatic]

You are very professional as an educator, Very well explained.
It's sad that the module (UI Automation) isn't free for home users.
But I can use these same functions with an AutoHotkey script.
It's just a little more complex, but much more powerful.
Allows you to navigate and control the functions of third-party applications by switching from one to another.

[ayushmoudgil]

This might potentially change my future as I am looking to switch careers, and by following you I hope i can make it happen!!!

[DonnieDish]

🎯 Key Takeaways for quick navigation:

00:25 *🎯 Handling Static UI Elements*
- Understanding UI elements with static attributes,
- Importance of static attribute values in automation.
01:01 *🔄 Transition to Dynamic UI Elements*
- Introduction to dynamic UI elements,
- Challenges posed by dynamically changing attribute values,
- Need for handling dynamic UI elements effectively.
02:04 *🛠️ Strategies for Dynamic UI Element Handling*
- Recognizing dynamic web or UI elements,
- Adapting CSS/UI selectors for dynamic attributes,
- Customizing Controls Repository for dynamic element management.

Made with HARPA AI

[SrdjanS_Automations]

Hi Andres,
Is there an option to use "Simulate Click" in Power Automate? (I don't want to lose control of the mouse in the automation)

[mbhagyasri]

Thanks Anders. This is something i wanted to try . Quick ask, can I ope. Word file and update data from excel? With this command

[KeinNiemand]

Is there anything else that can automate GUI like this (as in without relying on exact pixel coordinate or image recocnition to know where to click)? Power Automate can't be automated in the free version.

[anantchirmade]

I am trying to add an UI element from an app but in that app the element chooser just shows Full Pane as element instead of small element inside the Pane. Due to this I am unable to click on that item specifically.
Do you have any idea how to solve this

[joshuacammeraat]

Hi Anders,
I’ve got a problem and I don’t know how to fix it. The element ID is different everytime I open my page. So now the ID is “370”, but if I restart the page the values are different. So how could I make this work, so that the ID updates all the time, so it clicks the right button on the page.

[adityaprasad]

Hi I have stucked one of the project using power automation desktop if its possible you can explain one to one

[sridevisatheeshkumar]

in windows11, terminate process shows "CalculatorApp"

[i_lost_my_hitpointsdkpd]

Hey I have a question. Is there a way to do this in the background so people can do something else on the computer at the same time?