US Patent 10896545 Near eye display interface for artificial reality applications

A system includes a near eye display (NED) comprising a substantially transparent electronic display that is configured to display images in accordance with display instructions, and an imaging device configured to capture one or more images of a portions of a local area surrounding the NED. The system further includes a controller configured to determine a position of an object within the local area using the captured one or more images and location information associated with the object. The controller accesses supplemental information regarding the object, and updates the display instructions to cause the substantially transparent electronic display to display at least a portion of the supplemental information about the object. The display of the at least a portion of the supplemental information is positioned within a threshold distance of the determined position of the object in an augmented reality environment as presented via the substantially transparent electronic display.