US Patent 11568128 Automated determination of data values for form fields

Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives from a client device an image and a user identifier associated with a user of the client device. Based on the user identifier, the program further retrieves a set of historical transactions associated with the user, the program also uses a first machine learning model to predict a string based on the image. The program further uses a second machine learning model to predict a set of digits based on the image. Based on the set of historical transaction data, the string, and the set of digits, the program also determines a data value for a field in a form.