US Patent 11026766 Photo realistic rendering of smile image after treatment

A method may include: receiving facial image of the patient that depicts the patient's teeth; receiving a 3D model of the patient's teeth; determining color palette of the depiction of the patient's teeth; coding 3D model of the patient's teeth based on attributes of the 3D model; providing the 3D model, the color palette, and the coded 3D model to a neural network; processing the 3D model, the color palette, and the coded 3D model by the neural network to generate a processed image of the patient's teeth; simulating specular highlights on the processed image of the patient's teeth; and inserting the processed image of the patient's teeth into a mouth opening of the facial image.