• Become a Power user Intro to AutoHotkey Intermediate AutoHotkey Intermediate Objects GUIs are Easy w/AutoHotkey Painlessly switch from V1 to V2

Download Inspect.exe: the UI Automation / ACC tool from Microsoft

Get the Inspect.exe tool from Microsoft discussed in the below video

Master UIAutomation : Learn how to interact with controls like a pro

Master UIAutomation : Learn how to interact with controls like a pro

UIA can be used to automate browser actions and Accessibility Insights for Windows can provide more information about UIA automation.

  • 00:00 Alan and Isaias discussed how to use UIA for browser automation and Accessibility Insights for Windows for more info.
    • Isaias walked Alan through using UIA for browser automation, and they discussed how to get patterns and automate Chrome.
    • Find this video helpful? Like it and check out our other videos for more learnings.
    • Accessibility Insights for Windows can provide more information than UIA Viewer about objects and their patterns.
  • 03:25 Interact with controls using value, grid item, expand/collapse, scroll item, and selection patterns.
    • Using the value, grid item, expand/collapse, scroll item, and selection patterns, you can interact with controls to get information, expand/collapse, and select items.
    • The value pattern can be used to set the value of an element, but not to open or close a drop down.
  • 05:54 Set the value pattern to change the name of a folder automatically using UIA.
    • Set the value pattern to change the name of a folder automatically.
    • Using UIA, you must first find the item by its automation ID and then get the current pattern using the value you want.
  • 08:44 Find the element, get/set the value, and click the button to automate the process.
    • If the element is not found, loop until it is found or throw an error after 100 attempts.
    • Find the object with the automation ID, get the pattern value, and either get the value into a variable or set the value.
    • Find the button with the automation ID and use the click command to click it.
  • 11:56 Use WinExist to get a handle to a window, then use UIA’s element from handle to connect to the Chrome element for browser automation.
    • You can attach to a running instance of a browser to directly link to a particular tab.
    • WinExist checks if a window with a given title exists and returns an ID number if it does.
    • Using Winxist to get a handle to a window, UIA’s element from handle can be used to connect to the Chrome element for browser automation.
    • The tool does not provide the handle, which changes every time, so it must be done manually.
  • 17:24 Create a tool to automate Chrome actions using the UIA object and value pattern for the element’s automation ID.
    • The script gets the current ID for the browser window and returns the UIA object to use for clicking and other actions.
    • To use Chrome automation, you need to find the element with the automation ID and get the value pattern.
    • We want to create a tool that can be shared with teammates, is natively available on everyone’s computer, and doesn’t require any other tools or web drivers.
  • 20:44 Get familiar with UIA to find elements and learn more about UIL automation for Auto Hobby.
    • UIA is a tool that is easy to use once you understand the concept.
    • Find elements with automation ID, then get the pattern to learn more about UIL automation for Auto Hobby.
  • 22:32 Learning web scraping and API calls can be challenging due to the complexity of the methods and properties.
    • It’s difficult to teach web scraping and API calls due to the variety of methods and properties used by developers.

 


Comments are closed.