Patent attributes
System and methods for creating on-demand robotic process automation are described. In one example hardware processor-implemented method embodiment, an application providing graphical user interfaces is executed, and a monitoring program executing independently of the application. Using the monitoring program, a screen capture image is obtained of the graphical user interfaces. Graphical user interface elements are identified using a computerized image processing technique. Metadata on presence of confirmatory predictors for the elements, and confirmatory predictor vectors for the interfaces, are generated. Confusion indices for the confirmatory predictors and the confirmatory predictor vectors are calculated, Threshold values are generated based on the calculated confusion indices. A decision table is generated storing sequences of user interactions with the graphical user interface elements. A subset of the stored sequences is identified as yielding a successful outcome. A process automation model is generated and validated based on the identified subset, using the threshold values.
