Please wait, loading...

 

Using AI Builder with UI Flow to test capability of Robotic Process Automation in Power Automate

May 23, 2020
UI flows is one of the latest features released through Power Automate — providing Robotic Process Automation (RPA) capabilities on top of Power plateform

you can use UI flows to automate repetitive tasks in Windows and Web applications. UI flows records and plays back user interface actions (clicks, keyboard input, etc.) for applications that don’t have easy-to-use or complete APIs available.
Microsoft official :
There are some limitations to web UI flows which you need to understand before deciding on this approach:
  • Multi-Factor Authentication (MFA) is not supported,
  • use a tenant that doesn’t require MFA.
  • These Selenium IDE commands are not supported: Run, AnswerOnNextPrompt, ChooseCancelOnNextConfirmation, ChooseCancelOnNextPrompt, ChooseOkOnNextConfirmation, Debugger, ClickAt, DoubleClickAt, Echo, MouseOut, MouseUpAt, and MouseDownAt.
  • Right-click is not supported.
  • Additional Web UI flow input is generated when you use Foreach commands. To work around this issue, input any value into the extra fields. It doesn’t impact the playback.
  • If the .side file contains multiple test projects, only the first one that was created runs.
  • Playback directly in the Selenium IDE might not behave as intended. However, playback at runtime through the UI flow infrastructure behaves correctly.

Step by Step tutorial for Using AI Builder with UI Flow to test capability of Robotic Process Automation

  • Will train my model to read Internet Bills –  Refer AI Builder part 1
  • Use the trained Model in power Apps – Refer AI Builder part 1
  • Extract the Total Amount Collected information using Power apps- Refer AI Builder part 2
  • Will automate extracted Total Amount and other values to Microsoft dynamics 365 or Note or your Local database (Just for the sack of example) – Refer Ai Builder Video Part 3
  • Will use UI FLOW to do data entry in legacy system using Robotic Process Automation capability
https://i0.wp.com/microsoftdynamics.in/wp-content/uploads/2020/04/Microsoftdynamics365.png?fit=640%2C651&ssl=1
Microsoft Dynamics Community Profile

Learn more