US Patent 11172996 Instrument-based registration and alignment for augmented reality environments

Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to Registration Engine. The Registration Engine tracks positions of a fiducial marker relative to positions of an Augmented Reality (AR) headset device worn by a user. The Registration Engine receives respective registration landmarks that correspond with locations of a physical region of a patient's anatomy and the tracked positions of the fiducial marker. The Registration Engine generates an AR display of medical data at the AR headset device in alignment with the physical region of a patient's anatomy that corresponds with the respective registration landmarks.