US Patent 12020357 Augmentation of digital images with simulated surface coatings

An image augmentation system and method for simulating the application of a coating to a surface of an original image. A mask generator can perform a search to detect a recognized object depicted in the original image, and generate a object mask for the recognized object. A user interface can to receive an identification of a selected object and an identification of a selected coating to be simulated on the selected object, and display a painted image. A renderer can receive the object mask for the selected object and the selected coating and generate the painted image, each pixel of the painted image having a painted color determined based on the object mask, the coating, and the original image.