Laparoscope Augmentation for Minimally Invasive Liver Resection In medical collaboration with: Dr. Hubertus Feussner (Klinikum rechts der Isar) Dr. Thomas Mussack (Klinikum Innenstadt) Contact Person(s): Marco Feuerstein

Keywords: Registration / Visualization, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality, Past Projects

Abstract

In recent years, an increasing number of liver tumor indications were treated by minimally invasive laparoscopic resection. Besides the restricted view, a major issue in laparoscopic liver resection is the precise localization of the vessels to be divided. To navigate the surgeon to these vessels, pre-operative imaging data can hardly be used due to intra-operative organ deformations caused by appliance of carbon dioxide pneumoperitoneum and respiratory motion.

Therefore, we propose to use an optically tracked mobile C-arm providing cone-beam computed tomography imaging capability intra-operatively. After patient positioning, port placement, and carbon dioxide insufflation, the liver vessels are contrasted and a 3D volume is reconstructed during patient exhalation. Without any further need for patient registration, the volume can be directly augmented on the live laparoscope video. This augmentation provides the surgeon with essential aid in the localization of veins, arteries, and bile ducts to be divided or sealed.

Current research focuses on the intra-operative use and tracking of mobile C-arms as well as laparoscopic ultrasound, augmented visualization on the laparoscope's view, and methods to synchronize respiratory motion.

Publications

2013
	T. Reichl, J. Gardiazabal, N. Navab Electromagnetic servoing - a new tracking paradigm IEEE Transactions on Medical Imaging, vol. 32, no. 8, pp. 1526-1535, April 2013. Available online. (bib)
	T. Reichl Advanced Hybrid Tracking and Navigation for Computer-Assisted Interventions Dissertation. Official publication available at mediatum.ub.tum.de. (bib)
2009
	M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors IEEE Trans. Med. Imag., vol. 28, no. 6, pp. 951-967, June 2009 (bib)
2008
	J. Traub, T. Sielhorst, S.M. Heining, N. Navab Advanced Display and Visualization Concepts for Image Guided Surgery IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
	T. Sielhorst, M. Feuerstein, N. Navab Advanced Medical Displays: A Literature Review of Augmented Reality IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
	M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography Computer Aided Surgery, vol. 13, no. 5, pp. 311-323, September 2008 (bib)
	M. Baumhauer, M. Feuerstein, H.P. Meinzer, J. Rassweiler Navigation in Endoscopic Soft Tissue Surgery: Perspectives and Limitations Journal of Endourology, vol. 22, no. 4, pp. 1-16, April 2008 (bib)
	M. Feuerstein, T. Mussack, S.M. Heining, N. Navab Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection IEEE Trans. Med. Imag., vol. 27, no. 3, pp. 355-369, March 2008 (bib)
	M. Feuerstein Augmented Reality in Laparoscopic Surgery - New Concepts and Methods for Intraoperative Multimodal Imaging and Hybrid Tracking in Computer Aided Surgery Book, ISBN 978-3-8364-7783-3, Vdm Verlag Dr. Müller. (bib)
2007
	C. Bichlmeier, S.M. Heining, M. Rustaee, N. Navab Laparoscopic Virtual Mirror for Understanding Vessel Structure: Evaluation Study by Twelve Surgeons The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 13 - 16, 2007. (bib)
	M. Feuerstein, T. Reichl, J. Vogel, A. Schneider, H. Feußner, N. Navab Magneto-optic Tracking of a Flexible Laparoscopic Ultrasound Transducer for Laparoscope Augmentation Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October/November 2007. The original publication is available online at www.springerlink.com (bib)
	M. Feuerstein Augmented Reality in Laparoscopic Surgery - New Concepts for Intraoperative Multimodal Imaging PhD Thesis. The original (high-resolution) publication is available online at mediatum.ub.tum.de (bib)
	N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
	T. Reichl Online Error Correction for the Tracking of Laparoscopic Ultrasound Diploma Thesis. Technische Universität München, July 2007 (bib)
	M. Feuerstein, T. Mussack, S.M. Heining, N. Navab Registration-free Laparoscope Superimposition for Intra-Operative Planning of Liver Resection 3rd Russian-Bavarian Conference on Biomedical Engineering, Erlangen, Germany, July 2/3 2007 (bib)
	R. Bauernschmitt, M. Feuerstein, J. Traub, E.U. Schirmbeck, G. Klinker, R. Lange Optimal port placement and enhanced guidance in robotically assisted cardiac surgery Surgical Endoscopy, Volume 21, Number 4, April 2007 (bib)
	N. Navab, M. Feuerstein, C. Bichlmeier Laparoscopic Virtual Mirror - New Interaction Paradigm for Monitor Based Augmented Reality Virtual Reality, Charlotte, North Carolina, USA, March 10-14, 2007 (bib)
	M. Feuerstein, T. Mussack, S.M. Heining, N. Navab Registration-Free Laparoscope Augmentation for Intra-Operative Liver Resection Planning SPIE Medical Imaging, San Diego, California, USA, 17-22 February 2007 (bib)
2005
	M. Feuerstein, S.M. Wildhirt, R. Bauernschmitt, N. Navab Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2005), Palm Springs, USA, October 2005. The original publication is available online at www.springerlink.com (bib)
	J. Traub, S. Wiesner, M. Feuerstein, H. Feußner, N. Navab Evaluation of Calibration Methods for Laparoscope Augmentation 4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
	M. Feuerstein, N. Navab, E.U. Schirmbeck, S.M. Wildhirt, R. Lange, R. Bauernschmitt Endocsope Augmentation for Port Placement and Navigation for Rigid Anatomy 4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
	B. Olbrich, J. Traub, S. Wiesner, A. Wiechert, H. Feußner, N. Navab Respiratory Motion Analysis: Towards Gated Augmentation of the Liver Proceedings of Computer Assisted Radiology and Surgery (CARS 2005), pp. 248-253, Berlin, Germany, June 2005 (bib)
2004
	R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange Improved Preoperative Planning in Robotic Heart Surgery IEEE Proceedings of Computers in Cardiology (CinC 2004), pp. 773 - 776, Chicago, USA, September 2004 (bib)
	J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004 (bib)

Team

Contact Person(s)

Dr. Marco Feuerstein

Working Group

M.Sc. Armin Schneider

Dr. Christoph Bichlmeier

Prof. Dr. Hubertus Feussner

Dipl.-Inf. Univ. Jakob Vogel

Maxim Kipot

Prof. Dr. Nassir Navab

Dr. med. Sandro Heining

Prof. Dr. Thomas Mussack

Alumni

Dr. Joerg Traub

Dipl.-Inf. Univ. Stefan Wiesner

Dr. Tobias Reichl

Location

Ludwig-Maximilians-Universität München Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS Nussbaumstr. 20 80336 München Room: C2.06 Tel.: +49 89 5160-3615 Tel.: +49 89 5160-3635 Fax: +49 89 5160-3630

Visit our lab at Klinikum Innenstadt.

Klinikum rechts der Isar der Technischen Universitüt München Ismaninger Str. 22 81675 München IFL Lab - Room: 01.3a-c Tel.: +49 89 4140-6457 Fax: +49 89 4140-6458

Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Marco Feuerstein for available student projects within this research project.