ProjectLaparoscopeAugmentation

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Laparoscope Augmentation for Minimally Invasive Liver Resection

Laparoscope Augmentation for Minimally Invasive Liver Resection

In medical collaboration with:
Dr. Hubertus Feussner (Klinikum rechts der Isar)
Dr. Thomas Mussack (Klinikum Innenstadt)

Contact Person(s): Marco Feuerstein

Keywords: Registration / Visualization, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality, Past Projects

Abstract

In recent years, an increasing number of liver tumor indications were treated by minimally invasive laparoscopic resection. Besides the restricted view, a major issue in laparoscopic liver resection is the precise localization of the vessels to be divided. To navigate the surgeon to these vessels, pre-operative imaging data can hardly be used due to intra-operative organ deformations caused by appliance of carbon dioxide pneumoperitoneum and respiratory motion.

Therefore, we propose to use an optically tracked mobile C-arm providing cone-beam computed tomography imaging capability intra-operatively. After patient positioning, port placement, and carbon dioxide insufflation, the liver vessels are contrasted and a 3D volume is reconstructed during patient exhalation. Without any further need for patient registration, the volume can be directly augmented on the live laparoscope video. This augmentation provides the surgeon with essential aid in the localization of veins, arteries, and bile ducts to be divided or sealed.

Current research focuses on the intra-operative use and tracking of mobile C-arms as well as laparoscopic ultrasound, augmented visualization on the laparoscope's view, and methods to synchronize respiratory motion.

Publications

2013
T. Reichl, J. Gardiazabal, N. Navab
Electromagnetic servoing - a new tracking paradigm
IEEE Transactions on Medical Imaging, vol. 32, no. 8, pp. 1526-1535, April 2013. Available online. (bib)
T. Reichl
Advanced Hybrid Tracking and Navigation for Computer-Assisted Interventions
Dissertation. Official publication available at mediatum.ub.tum.de. (bib)
2009
M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab
Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors
IEEE Trans. Med. Imag., vol. 28, no. 6, pp. 951-967, June 2009 (bib)
2008
J. Traub, T. Sielhorst, S.M. Heining, N. Navab
Advanced Display and Visualization Concepts for Image Guided Surgery
IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
T. Sielhorst, M. Feuerstein, N. Navab
Advanced Medical Displays: A Literature Review of Augmented Reality
IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab
New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography
Computer Aided Surgery, vol. 13, no. 5, pp. 311-323, September 2008 (bib)
M. Baumhauer, M. Feuerstein, H.P. Meinzer, J. Rassweiler
Navigation in Endoscopic Soft Tissue Surgery: Perspectives and Limitations
Journal of Endourology, vol. 22, no. 4, pp. 1-16, April 2008 (bib)
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection
IEEE Trans. Med. Imag., vol. 27, no. 3, pp. 355-369, March 2008 (bib)
M. Feuerstein
Augmented Reality in Laparoscopic Surgery - New Concepts and Methods for Intraoperative Multimodal Imaging and Hybrid Tracking in Computer Aided Surgery
Book, ISBN 978-3-8364-7783-3, Vdm Verlag Dr. Müller. (bib)
2007
C. Bichlmeier, S.M. Heining, M. Rustaee, N. Navab
Laparoscopic Virtual Mirror for Understanding Vessel Structure: Evaluation Study by Twelve Surgeons
The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 13 - 16, 2007. (bib)
M. Feuerstein, T. Reichl, J. Vogel, A. Schneider, H. Feußner, N. Navab
Magneto-optic Tracking of a Flexible Laparoscopic Ultrasound Transducer for Laparoscope Augmentation
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October/November 2007.
The original publication is available online at www.springerlink.com
(bib)
M. Feuerstein
Augmented Reality in Laparoscopic Surgery - New Concepts for Intraoperative Multimodal Imaging
PhD Thesis. The original (high-resolution) publication is available online at mediatum.ub.tum.de (bib)
N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier
Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures
IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
T. Reichl
Online Error Correction for the Tracking of Laparoscopic Ultrasound
Diploma Thesis. Technische Universität München, July 2007 (bib)
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Registration-free Laparoscope Superimposition for Intra-Operative Planning of Liver Resection
3rd Russian-Bavarian Conference on Biomedical Engineering, Erlangen, Germany, July 2/3 2007 (bib)
R. Bauernschmitt, M. Feuerstein, J. Traub, E.U. Schirmbeck, G. Klinker, R. Lange
Optimal port placement and enhanced guidance in robotically assisted cardiac surgery
Surgical Endoscopy, Volume 21, Number 4, April 2007 (bib)
N. Navab, M. Feuerstein, C. Bichlmeier
Laparoscopic Virtual Mirror - New Interaction Paradigm for Monitor Based Augmented Reality
Virtual Reality, Charlotte, North Carolina, USA, March 10-14, 2007 (bib)
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Registration-Free Laparoscope Augmentation for Intra-Operative Liver Resection Planning
SPIE Medical Imaging, San Diego, California, USA, 17-22 February 2007 (bib)
2005
M. Feuerstein, S.M. Wildhirt, R. Bauernschmitt, N. Navab
Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2005), Palm Springs, USA, October 2005.
The original publication is available online at www.springerlink.com
(bib)
J. Traub, S. Wiesner, M. Feuerstein, H. Feußner, N. Navab
Evaluation of Calibration Methods for Laparoscope Augmentation
4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
M. Feuerstein, N. Navab, E.U. Schirmbeck, S.M. Wildhirt, R. Lange, R. Bauernschmitt
Endocsope Augmentation for Port Placement and Navigation for Rigid Anatomy
4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
B. Olbrich, J. Traub, S. Wiesner, A. Wiechert, H. Feußner, N. Navab
Respiratory Motion Analysis: Towards Gated Augmentation of the Liver
Proceedings of Computer Assisted Radiology and Surgery (CARS 2005), pp. 248-253, Berlin, Germany, June 2005 (bib)
2004
R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange
Improved Preoperative Planning in Robotic Heart Surgery
IEEE Proceedings of Computers in Cardiology (CinC 2004), pp. 773 - 776, Chicago, USA, September 2004 (bib)
J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker
Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery
Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004 (bib)

Team

Contact Person(s)

Marco Feuerstein
Dr. Marco Feuerstein

Working Group

Armin Schneider
M.Sc. Armin Schneider
Christoph Bichlmeier
Dr. Christoph Bichlmeier
Hubertus Feussner
Prof. Dr. Hubertus Feussner
Jakob Vogel
Dipl.-Inf. Univ. Jakob Vogel
Maxim Kipot
Maxim Kipot
Nassir Navab
Prof. Dr. Nassir Navab
Sandro Heining
Dr. med. Sandro Heining
Thomas Mussack
Prof. Dr. Thomas Mussack

Alumni

Joerg Traub
Dr. Joerg Traub
Stefan Wiesner
Dipl.-Inf. Univ. Stefan Wiesner
Tobias Reichl
Dr. Tobias Reichl

Location



Ludwig-Maximilians-Universität München
Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS
Nussbaumstr. 20
80336 München

Room: C2.06
Tel.: +49 89 5160-3615
Tel.: +49 89 5160-3635
Fax: +49 89 5160-3630
Visit our lab at Klinikum Innenstadt.



Klinikum rechts der Isar
der Technischen Universitüt München
Ismaninger Str. 22
81675 München

IFL Lab - Room: 01.3a-c
Tel.: +49 89 4140-6457
Fax: +49 89 4140-6458
Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Marco Feuerstein for available student projects within this research project.

Edit | Attach | Refresh | Diffs | More | Revision r1.9 - 14 Sep 2007 - 13:07 - MarcoFeuerstein

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif