ProjectNarvis

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

narvis.jpg

NARVIS - navigated augmented reality visualization system

Advanced visualization is getting increasingly important for the operation room of the future. The increasing number of available medical images must be presented to surgery team in new ways in order to support them rather than overloading with more information. In our project NARVIS we integrate an HMD-based (head mounted display) AR system into the operation room for 3D in situ visualization of computed tomography (CT) images. The final system aims at spinal surgery. The work is in close collaboration with our project partners “Klinikum für Unfallchirgie” at LMU, A.R.T. Weilheim, and Siemens Corporate Research in Princeton. The project is funded by Bayerische Forschungsstiftung.

NARVIS


In a phantom experiment we have used a 3D augmented reality (AR) workspace, in which the user wears a video-feed-through head-mounted display to perform operative tasks in thoracoscopic spine surgery. The set up was used to observe and fuse preoperative 3D CT-data and intraoperative 3D fluoroscopy-data as well as 2D endoscopic images in-situ, i.e. in their actual location, overlaid onto a stereoscopic video view. In-situ visualization of rendered three-dimensional volumes (e.g. implants, vascular and neural structures) facilitates the understanding of the object's three-dimensional structure. Furthermore, the system has the ability to track hand-held surgical instruments in 2 different techniques. Graphically enhanced instruments improve the perception of tool position and orientation in respect to targets in the rendered volume. With an intuitive augmented reality user interface the surgeon controls the visualization of the volumetric data. In the phantom experiment the system has proven to effectively enhance information in minimally-invasive spinal surgery.

HMD-skizze_english_height400.jpg

NARVIS sketch

Group coordinator

Tobias Sielhorst

Related publications

J. Traub
New Concepts for Design and Workflow Driven Evaluation of Computer Assisted Surgery Solutions
Dissertation an der Fakultät für Informatik, Technische Universität München, 2008 ( online version available here) (bib)
T. Sielhorst
New Methods for Medical Augmented Reality
Dissertation an der Fakultät für Informatik, Technische Universität München, 2008 ( online version available here) (bib)
T. Sielhorst, Wu Sa, A. Khamene, F. Sauer, N. Navab
Measurement of absolute latency for video see through augmented reality
Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'07), Nara, Japan, November 2007 (bib)
T. Sielhorst, M. Bauer, O. Wenisch, G. Klinker, N. Navab
Online Estimation of the Target Registration Error for n-ocular Optical Tracking Systems
to appear Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 2007 (bib)
T. Sielhorst, C. Bichlmeier, S.M. Heining, N. Navab
Depth perception a major issue in medical AR: Evaluation study by twenty surgeons
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 364-372
The original publication is available online at www.springerlink.com
(bib)
T. Sielhorst, M. Feuerstein, J. Traub, O. Kutter, N. Navab
CAMPAR: A software framework guaranteeing quality for medical augmented reality
International Journal of Computer Assisted Radiology and Surgery, 2006; Vol. 1 Suppl. 1, page 29 - 30.
The original publication is available online at www.springerlink.com
(bib)


Edit | Attach | Refresh | Diffs | More | Revision r1.4 - 27 Jul 2006 - 06:28 - TobiasSielhorst

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif