<p>This paper addresses fundamental limitations in visual GUI automation by redefining current approaches as <i>process-based</i> and introducing a novel <i>model-based</i> alternative. By addressing the inherent stochasticity in GUI environments through insights from software testing, machine vision, robotics, and human cognition, I present a theoretical framework that enables integration and unit testing of GUI automation and significantly improves automation robustness. The approach reduces code complexity and supports larger automation applications, potentially enabling GUI automation in previously impractical domains.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Model-based GUI automation

  • Joshua Spinak

摘要

This paper addresses fundamental limitations in visual GUI automation by redefining current approaches as process-based and introducing a novel model-based alternative. By addressing the inherent stochasticity in GUI environments through insights from software testing, machine vision, robotics, and human cognition, I present a theoretical framework that enables integration and unit testing of GUI automation and significantly improves automation robustness. The approach reduces code complexity and supports larger automation applications, potentially enabling GUI automation in previously impractical domains.