US Patent 10444908 Virtual touchpads for wearable and portable devices

Systems and methods for using portions of the surface around a wearable smart device as virtual touchpads for data and command entry are disclosed. For wearable smart devices worn on the wrist like smartwatches, the skin area over the back hand as well as the surface area over the arm adjacent to the device may serve as virtual touchpads. One or more side looking cameras facing each virtual touchpad may be used to detect touches and movements by one or more fingers on the virtual touchpads to simulate equivalent tactile gestures that control the device. Various surface artifact movements captured by the cameras may be used to confirm that the finger is actually touching the virtual touchpad and not just hovering above it. Sound sensors that independently detect and locate finger touches, as well as motion sensors that detect vibration corresponding to actual touch tap events, may be combined with the cameras to improve the detection accuracy of the tactile gestures. Touch position may also be detected by triangulation of encoded RF signals that propagate from one side of the device via the operator body to the back hand virtual touchpad. Two or more virtual touchpads can operate in interchangeable or complementary modes. During interchangeable operation mode, all virtual touchpads may respond to all the tactile gestures supported by the device. In complementary mode, some virtual touchpads may be restricted to recognize only a specific subset of the supported gestures.