ProjectDepthPerceptionMedicalAR

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Improving Depth Perception and Perception of Layout for In-Situ Visualization in Medical Augmented Reality

Improving Depth Perception and Perception of Layout for In-Situ Visualization in Medical Augmented Reality

In medical collaboration with:
Trauma Surgery Department, Klinikum Innenstadt, LMU, Munich, Germany

Scientific Director: Nassir Navab

Contact Person(s): Christoph Bichlmeier

Keywords: Medical Augmented Reality, HMD and Visualization

Abstract

In-situ visualization in medical augmented reality (AR) using for instance a video see-through head mounted display (HMD) and an optical tracking system enables the stereoscopic view on visualized CT data registered with the real anatomy of a patient. Data can aligned with the required accuracy and the surgeons do not have to analyze data on an external monitor or images attached to the wall somewhere in the operating room. Thanks to a medical AR system like mentioned before, surgeons get a direct view onto and also ”into” the patient. Mental registration of medical imagery with the operation site is not necessary anymore. In addition surgical instruments can be augmented inside the human body. Bringing medical imagery and surgical instruments in the same field of action provides the most intuitive way to understand the patient’s anatomy within the region of interest and allows for the development of completely new generations of surgical navigation systems.
Unfortunately, this method of presenting medical data suffers from a serious lack. Virtual imagery, such as a volume rendered spinal column, can only be displayed superimposed on real objects. If virtual entities of the scene are expected behind real ones, like the virtual spinal column beneath the real skin surface, this problem implicates incorrect perception of the viewed objects respective their distance to the observer. The strong visual depth cue interposition is responsible for misleading depth perception. This project aims at the development and evaluation of methods to improve depth perception for in-situ visualization in medical AR. Its intention is to provide an extended view onto the human body that allows an intuitive localization of visualized bones and tissue.

Videos

Methods for focus and context visualization in HMD-based Medical Augmented Reality for improved depth perception.

The video of our MICCAI 2006 paper Depth Perception a Major Issue in Medical Augmented Reality

Publications

2011
M. Wieczorek, A. Aichert, P. Fallavollita, O. Kutter, A. Ahmadi, L. Wang, N. Navab
Interactive 3D visualization of a single-view X-Ray image
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2011), Toronto, Canada, September 2011. (bib)
2010
C. Bichlmeier
Immersive, Interactive and Contextual In-Situ Visualization for Medical Applications
Dissertation an der Fakultät für Informatik, Technische Universität München, 2010 ( online version available here) (bib)
M. Wieczorek, A. Aichert, O. Kutter, C. Bichlmeier, J. Landes, S.M. Heining, E. Euler, N. Navab
GPU-accelerated Rendering for Medical Augmented Reality in Minimally-Invasive Procedures
Proceedings of Bildverarbeitung fuer die Medizin (BVM 2010), Aachen, Germany, March 14-16 2010 (bib)
2009
C. Bichlmeier, M. Kipot, S. Holdstock, S.M. Heining, E. Euler, N. Navab
A Practical Approach for Intraoperative Contextual In-Situ Visualization
International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2009), London, UK, September 2009 (bib)
2008
O. Kutter, A. Aichert, C. Bichlmeier, J. Traub, S.M. Heining, B. Ockert, E. Euler, N. Navab
Real-time Volume Rendering for High Quality Visualization in Augmented Reality
International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2008), USA, New York, September 2008 (bib)
C. Bichlmeier, B. Ockert, O. Kutter, M. Rustaee, S.M. Heining, N. Navab
The Visible Korean Human Phantom: Realistic Test & Development Environments for Medical Augmented Reality
International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2008), USA, New York, September 2008 (bib)
F. Wimmer, C. Bichlmeier, S.M. Heining, N. Navab
Creating a Vision Channel for Observing Deep-Seated Anatomy in Medical Augmented Reality
Proceedings of Bildverarbeitung fuer die Medizin (BVM 2008), Munich, Germany, April 2008 (bib)
2007
C. Bichlmeier, F. Wimmer, S.M. Heining, N. Navab
Contextual Anatomic Mimesis: Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality
The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 13 - 16, 2007. (bib)
N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier
Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures
IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
C. Bichlmeier, T. Sielhorst, S.M. Heining, N. Navab
Improving Depth Perception in Medical AR: A Virtual Vision Panel to the Inside of the Patient
Proceedings of Bildverarbeitung fuer die Medizin (BVM 2007), Munich, Germany, March 2007 (bib)
2006
C. Bichlmeier, N. Navab
Virtual Window for Improved Depth Perception in Medical AR
International Workshop on Augmented Reality environments for Medical Imaging and Computer-aided Surgery (AMI-ARCS 2006), Copenhagen, Denmark, October 2006 (bib)
T. Sielhorst, C. Bichlmeier, S.M. Heining, N. Navab
Depth perception a major issue in medical AR: Evaluation study by twenty surgeons
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 364-372
The original publication is available online at www.springerlink.com
(bib)

Clinical Relevance

Sandro Heining, Ekkehard Euler, Ben Ockert

Team

Contact Person(s)

Christoph Bichlmeier
Dr. Christoph Bichlmeier

Working Group

Ekkehard Euler
Prof. Dr. Ekkehard Euler
Matthias Wieczorek
M.Sc. Matthias Wieczorek
Nassir Navab
Prof. Dr. Nassir Navab
Oliver Kutter
Dr. Oliver Kutter
Sandro Heining
Dr. med. Sandro Heining
Stuart Holdstock
M.Sc. Stuart Holdstock

Alumni

Andre Aichert
Andre Aichert
Felix Wimmer
Felix Wimmer
Maxim Kipot
Maxim Kipot
Mohammad Rustaee
Mohammad Rustaee
Tobias Sielhorst
Dr. Tobias Sielhorst

Location



Ludwig-Maximilians-Universität München
Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS
Nussbaumstr. 20
80336 München

Room: C2.06
Tel.: +49 89 5160-3615
Tel.: +49 89 5160-3635
Fax: +49 89 5160-3630
Visit our lab at Klinikum Innenstadt.



internal project page

Please contact Christoph Bichlmeier for available student projects within this research project.

Edit | Attach | Refresh | Diffs | More | Revision r1.2 - 17 Sep 2007 - 09:30 - MartinHorn

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif