US Patent 10220303 Gesture-based music game

A method including displaying a multi-part visual cue that instructs a player to perform a gesture at a specified time, the multi-part visual cue including a first part indicating the gesture that is to be performed at the specified time, and a second part providing an indication of i) the specified time, and ii) a preparation period before the specified time, wherein the distance between the first and the second parts is variable over time, receiving, from a video camera, position information associated with positions of the player over time, determining a first displacement of the player using the position information, determining whether the first displacement of the player matches a first target displacement criterion associated with the multi-part visual cue, when the first displacement matches the first target displacement criterion within a timing window of the specified time, altering a gameplay characteristic of the video game.