US Patent 7951070 Object observation system and method utilizing three dimensional imagery and real time imagery during a procedure

An object observation method and system including an endoscope, at least one treating device, a first detecting portion for detecting information indicating an observation direction of the endoscope, a second detecting portion for detecting information indicating a treatment direction of the treating device, a three dimensional virtual image data storing portion for storing three dimensional image data prepared in advance, a virtual image data processing portion for creating virtual image data based on the information indicating the observation direction and the treatment direction, first and second three dimensional image display monitors, each having first and second image display devices, and switch sections for instructing change of display mode of the second image display devices.