Approaches to enable a computing device, such as a phone or tablet computer, to use sensor information obtained from sensors of the computing device to interpret one or more gestures and/or other input provided by the user. In particular, the computing device may use information about the movement of the device gathered from an accelerometer or gyroscope in combination with input data detected by the touch screen or cameras of the device in order to disambiguate between several different types of gestures for the device.