US Patent 9361730 Interactions of tangible and augmented reality objects

Method, computer program product, and apparatus for providing interactions of tangible and augmented reality objects are disclosed. In one embodiment, a method for use with an augmented reality enabled device (ARD) comprises performing 3-dimensional tracking of one or more objects based at least in part on captured images of the one or more objects, detecting a state change of at least one object of the one or more objects based at least in part on the captured images, and causing an augmentation to be rendered in response to the state change of the at least one object, where a type of the augmentation is based at least in part on the state change of the at least one object.