US Patent 10310675 User interface apparatus and control method

A three-dimensional image of an operation surface and a region upward thereof is acquired, a hand region is extracted from the three-dimensional image, and the position of a fingertip is specified based on the extracted hand region. A touch on the operation surface is detected based on the operation surface included in the three-dimensional image and the specified position of the fingertip, and if a touch is detected, the direction of the fingertip is specified, and a position obtained by shifting the position of the fingertip by a predetermined amount in the direction opposite to the specified direction of the fingertip is determined as the touch position.