US Patent 9789403 System for interactive image based game

A method for real time processing of images providing a real time preview of face images for interaction with a game environment. Images from one or more image sensors are processed providing a modified image of a certain size and certain shape, for algorithmically detecting and tracking faces in the modified image for a real time preview of face images overlaid on a game environment. The real time preview of face images is configured for user control for interaction with the game environment. A facial gesture control functionality is disclosed for the execution of game commands allowing control of the real time preview of a face images for interaction with the game environment. The method of the present invention further discloses real time processing of images from a second image sensor for a real time preview of a second face images for interaction with the game environment. The present invention further discloses a method for real time processing of images from a first and second image sensor for a real time preview of face images overlaid on a real time preview of background images.