GUI automation is the process of simulating mouse and keyboard actions on windows and controls. GUI automation gives you the capability to automatically complete tasks only available via Graphical user interfaces. The easiest way to automate is usually via an API, but many legacy apps don’t offer an API. With GUI automation, supported by robotic process automation (RPA) and software robots, you can record a process via Graphical user interfaces and automate its recurrence with software robots.

GUI transformed the way we work with computers. Instead of working from the console, we can now use a keyboard and mouse to interact with a screen that can display an easily comprehensible visual interface. GUI automation, however, is the next step.

GUI automation also supports data scraping, screen scraping, automated testing, screen recordings, automated data entry, computer visions, application integration, and content migration.