Patent attributes
Disclosed is a system for recording and storing sequences of operations that may be performed on a client device. During a training phase, the system collects information about operations performed by a user or by an automatic application crawling program. Information about operations may include view-structure data about components of a user interface and event data about interactions the user has with the interface components and the outcome of such interactions. The operation data is stored in an operation graph that may represent how specific user interactions with interface components can cause transitions to new view-structures of the same or different applications on the client device. The data stored in the operation graph may be used to construct new sequences of operations for later execution, for example, in response to a user query.
