No occlusion handling (left) and instrument and glove occlusion handling (right)
Video image (left) and augmented scene with volume rendering and instrument (right)
Mirror texture (left) and augmented scene with mirror (right)
Mirror without (left) and with zoom (right)
MPR and volume rendering (left) and instrument aligned MPR (right)
|Title:||Evaluation of Advanced real-time Visualization Techniques for Medical Augmented Reality|
|Abstract:|| In recent years GPUs have evolved from fixed pipeline to fully programmable highly parallel architectures. These advances have led to equal improvements in the field of real-time medical image visualization. Combined with modern video see-through head-mounted displays this offers great opportunities for real-time, high-quality augmented reality visualization of medical data in interventional or surgical settings. Especially in minimally-invasive procedures, detailed, task-specific, visualization aids the physician in understanding the patient-specific anatomy and supports the navigation of medical instruments to the region of interest, in absence of a direct line of sight onto the operating situs.|
A possible medical AR configuration is to overlay real video camera images of e.g. a torso with a virtual image generated from 3D patient data. Recent approaches have dealt with the integration of hardware accelerated volume rendering into such an environment.
This work investigates the integration of advanced rendering techniques, such as virtual mirror and focus and context rendering for an improved visual perception of the augmented reality scene. Furthermore, real-time occlusion handling of real and virtual objects has been added. The techniques have been efficiently implemented in GPU programs and allow real-time visualization on computationally demanding stereo video see through AR systems.
|Area:||Registration / Visualization, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality|