MarcoFeuerstein

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Marco Feuerstein
(Dr. rer. nat., Dipl.-Inf. Univ.)

Now works at Lyft.

Research

Publications

Journal Articles

2012
P. Lo, B. v. Ginneken, J. M. Reinhardt, T. Yavarna, P. A. d. Jong, B. Irving, C. Fetita, M. Ortner, R. Pinho, J. Sijbers, M. Feuerstein, A. Fabijanska, C. Bauer, R. Beichel, C. S. Mendoza, R. Wiemker, J. Lee, A. P. Reeves, S. Born, weinheimer, E. M. v. Rikxoort, J. Tschirren, K. Mori, B. Odry, D. P. Naidich, I. Hartmann, E. A. Hoffman, M. Prokop, J. H. Pedersen, M. d. Bruijne
Extraction of Airways from CT (EXACT'09)
IEEE Transactions on Medical Imaging, July 2012 (bib)
M. Feuerstein, B. Glocker, T. Kitasaka, Y. Nakamura, S. Iwano, K. Mori
Mediastinal Atlas Creation from 3-D Chest Computed Tomography Images: Application to Automated Detection and Station Mapping of Lymph Nodes
Medical Image Analysis, vol. 16, no. 1, pp. 63-74, January 2012.
The original publication is available online at www.elsevier.com
(bib)
2011
X. Luo, M. Feuerstein, T. Kitasaka, K. Mori
Robust Bronchoscope Motion Tracking Using Sequential Monte Carlo Methods in Navigated Bronchoscopy: Dynamic Phantom and Patient Validation
International Journal of Computer Assisted Radiology and Surgery. (bib)
D. Deguchi, M. Feuerstein, T. Kitasaka, Y. Suenaga, I. Ide, H. Murase, K. Imaizumi, Y. Hasegawa, K. Mori
Real-time marker-free patient registration for electromagnetic navigated bronchoscopy : a phantom study
International Journal of Computer Assisted Radiology and Surgery.
The original publication is available online at www.springerlink.com
(bib)
2010
X. Luo, M. Feuerstein, D. Deguchi, T. Kitasaka, T. Hirotsugu, K. Mori
Development and Comparison of New Hybrid Motion Tracking for Bronchoscopic Navigation
Medical Image Analysis. Special issue on Computer Assisted Interventions. Accepted for publication, 17 November 2010. (bib)
2009
C. Bichlmeier, S.M. Heining, M. Feuerstein, N. Navab
The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments
IEEE Trans. Med. Imag., vol. 28, no. 9, pp. 1498-1510, September 2009 (bib)
D. Deguchi, K. Mori, M. Feuerstein, T. Kitasaka, C. R. Maurer, Jr., Y. Suenaga, H. Takabatake, M. Mori, H. Natori
Selective image similarity measure for bronchoscope tracking based on image registration
Medical Image Analysis, vol. 13, no. 4, pp. 621-633, August 2009 (bib)
M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab
Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors
IEEE Trans. Med. Imag., vol. 28, no. 6, pp. 951-967, June 2009 (bib)
2008
T. Sielhorst, M. Feuerstein, N. Navab
Advanced Medical Displays: A Literature Review of Augmented Reality
IEEE/OSA Journal of Display Technology; Special Issue on Medical Displays, Volume 4, Issue 4, Dec. 2008 (bib)
M. Feuerstein, T. Reichl, J. Vogel, J. Traub, N. Navab
New Approaches to Online Estimation of Electromagnetic Tracking Errors for Laparoscopic Ultrasonography
Computer Aided Surgery, vol. 13, no. 5, pp. 311-323, September 2008 (bib)
M. Baumhauer, M. Feuerstein, H.P. Meinzer, J. Rassweiler
Navigation in Endoscopic Soft Tissue Surgery: Perspectives and Limitations
Journal of Endourology, vol. 22, no. 4, pp. 1-16, April 2008 (bib)
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection
IEEE Trans. Med. Imag., vol. 27, no. 3, pp. 355-369, March 2008 (bib)
2007
N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier
Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures
IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
R. Bauernschmitt, M. Feuerstein, J. Traub, E.U. Schirmbeck, G. Klinker, R. Lange
Optimal port placement and enhanced guidance in robotically assisted cardiac surgery
Surgical Endoscopy, Volume 21, Number 4, April 2007 (bib)

International Conferences / Symposiums / Workshops

F. Kromp, S. Taschner-Mandl, M. Ambros, M. Berneder, L. Fischer, M. Feuerstein, A. Hanbury, I.M. Ambros, P.F. Ambros
Deep learning based tool to analyze I-FISH spots in consecutive sections of heterogeneously amplified neuroblastoma tumors
Advances in Neuroblastoma Research, San Francisco, USA, May 2018.
2012
Y. Yagi, M. Groher, M. Feuerstein, M. Onozato, H. Heibel, N. Navab
Overcoming Challenges in Histology 3D Imaging
11th European Congress on Telepathology and 5th International Congress on Virtual Microscopy, Venice, Italy, June 2011. (bib)
2011
M. Feuerstein, H. Heibel, J. Gardiazabal, N. Navab, M. Groher
Reconstruction of 3-D Histology Images by Simultaneous Deformable Registration
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2011), Toronto, Canada, September 2011.
The original publication is available online at www.springerlink.com
(bib)
K. Mori, T. Kugo, X. Luo, P. Dressel, T. Reichl, M. Feuerstein, N. Navab, T. Kitasaka
Endobronchial ultrasound endoscope navigation system based on CT-US calibration
Computer Assisted Radiology and Surgery, Berlin, Germany, June 2011 (bib)
X. Luo, M. Feuerstein, T. Kitasaka, K. Mori
On scale invariant features and sequential Monte Carlo sampling for bronchoscope tracking
SPIE Medical Imaging, Orlando, Florida, USA, February 2011 (bib)
X. Luo, M. Feuerstein, T. Kitasaka, K. Mori
A novel bronchoscope tracking method for bronchoscopic navigation using a low cost optical mouse sensor
SPIE Medical Imaging, Orlando, Florida, USA, February 2011 (bib)
2010
X. Luo, T. Reichl, M. Feuerstein, T. Kitasaka, K. Mori
Modified Hybrid Bronchoscope Tracking Based on Sequential Monte Carlo Sampler: Dynamic Phantom Validation
Asian Conference on Computer Vision, Queenstown, New Zealand, November 2010 (bib)
T. Kitasaka, H. Yano, M. Feuerstein, K. Mori
Bronchial region extraction from 3D chest CT image by voxel classification based on local intensity structure
Third International Workshop on Pulmonary Image Analysis, September 2010 (bib)
X. Luo, M. Feuerstein, T. Reichl, T. Kitasaka, K. Mori
An Application Driven Comparison of Several Feature Extraction Algorithms in Bronchoscope Tracking During Navigated Bronchoscopy
5th International Workshop on Medical Imaging and Augmented Reality, Sep 2010, Beijing (bib)
M. Feuerstein, T. Sugiura, D. Deguchi, T. Reichl, T. Kitasaka, K. Mori
Marker-free Registration for Electromagnetic Navigation Bronchoscopy under Respiratory Motion
5th International Workshop on Medical Imaging and Augmented Reality, Sep 2010, Beijing (bib)
P. Dressel, M. Feuerstein, T. Reichl, T. Kitasaka, N. Navab, K. Mori
Direct Co-Calibration of Endobronchial Ultrasound and Video
5th International Workshop on Medical Imaging and Augmented Reality, Sep 2010, Beijing (bib)
X. Luo, M. Feuerstein, T. Sugiura, T. Kitasaka, K. Mori, K. Imaizumi, Y. Hasegawa
Towards hybrid bronchoscope tracking under respiratory motion: evaluation on a dynamic motion phantom
SPIE Medical Imaging, San Diego, California, USA, February 2010 (bib)
M. Feuerstein, T. Kitasaka, K. Mori
Adaptive Model Based Pulmonary Artery Segmentation in 3D Chest CT
SPIE Medical Imaging, San Diego, California, USA, February 2010 (bib)
2009
M. Feuerstein, T. Kitasaka, K. Mori
Automated Anatomical Likelihood Driven Extraction and Branching Detection of Aortic Arch in 3-D Chest CT
Second International Workshop on Pulmonary Image Analysis, September 2009 (bib)
M. Feuerstein, T. Kitasaka, K. Mori
Adaptive Branch Tracing and Image Sharpening for Airway Tree Extraction in 3-D Chest CT
Second International Workshop on Pulmonary Image Analysis, September 2009 (bib)
M. Feuerstein, D. Deguchi, T. Kitasaka, S. Iwano, K. Imaizumi, Y. Hasegawa, Y. Suenaga, K. Mori
Automatic Mediastinal Lymph Node Detection in Chest CT
SPIE Medical Imaging, Orlando, Florida, USA, February 2009 (bib)
Z. Jiang, K. Mori, Y. Nimura, M. Feuerstein, T. Kitasaka, Y. Suenaga, Y. Hayashi, E. Ito, M. Fujii, T. Nagatani, Y. Kajita, T. Wakabayashi, J. Yoshida
An Improved Method for Compensating Ultra-tiny Electromagnetic Tracker Utilizing Position and Orientation Information and Its Application to a Flexible Neuroendoscopic Surgery Navigation System
SPIE Medical Imaging, Orlando, Florida, USA, February 2009 (bib)
T. Sugiura, D. Deguchi, M. Feuerstein, T. Kitasaka, Y. Suenaga, K. Mori
A method for accelerating bronchoscope tracking based on image registration by using GPU
SPIE Medical Imaging, Orlando, Florida, USA, February 2009 (bib)
2008
T. Wendler, J. Traub, T. Lasser, M. Feuerstein, J. Vogel, S. I. Ziegler, N. Navab
Combined ultrasound and gamma probe imaging for examination of thyroid nodules
Proceedings of Annual Meeting of Society of Nuclear Medicine (SNM 2008), New Orleans, USA, June 2008 (bib)
2007
T. Wendler, M. Feuerstein, J. Traub, T. Lasser, J. Vogel, F. Daghighian, S. I. Ziegler, N. Navab
Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 29 - November 2007, LNCS 4792 (2), pp. 909-917 (bib)
M. Feuerstein, T. Reichl, J. Vogel, A. Schneider, H. Feußner, N. Navab
Magneto-optic Tracking of a Flexible Laparoscopic Ultrasound Transducer for Laparoscope Augmentation
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October/November 2007.
The original publication is available online at www.springerlink.com
(bib)
N. Navab, M. Feuerstein, C. Bichlmeier
Laparoscopic Virtual Mirror - New Interaction Paradigm for Monitor Based Augmented Reality
Virtual Reality, Charlotte, North Carolina, USA, March 10-14, 2007 (bib)
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Registration-Free Laparoscope Augmentation for Intra-Operative Liver Resection Planning
SPIE Medical Imaging, San Diego, California, USA, 17-22 February 2007 (bib)
2006
M. Feuerstein, K. Filippatos, O. Kutter, E.U. Schirmbeck, R. Bauernschmitt, N. Navab
A Novel Segmentation and Navigation Tool for Endovascular Stenting of Aortic Aneurysms
International Journal of Computer Assisted Radiology and Surgery, 2006; Vol. 1 Suppl. 1, page 280 - 282.
The original publication is available online at www.springerlink.com
(bib)
T. Sielhorst, M. Feuerstein, J. Traub, O. Kutter, N. Navab
CAMPAR: A software framework guaranteeing quality for medical augmented reality
International Journal of Computer Assisted Radiology and Surgery, 2006; Vol. 1 Suppl. 1, page 29 - 30.
The original publication is available online at www.springerlink.com
(bib)
2005
M. Feuerstein, S.M. Wildhirt, R. Bauernschmitt, N. Navab
Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2005), Palm Springs, USA, October 2005.
The original publication is available online at www.springerlink.com
(bib)
2004
R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange
Improved Preoperative Planning in Robotic Heart Surgery
IEEE Proceedings of Computers in Cardiology (CinC 2004), pp. 773 - 776, Chicago, USA, September 2004 (bib)
J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker
Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery
Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004 (bib)

National Conferences / Symposiums / Workshops

2010
T. Sugiura, M. Feuerstein, T. Kitasaka, Y. Suenaga, K. Imaizumi, Y. Hasegawa, K. Mori
A study on a breathing motion compensation for bronchoscope tracking based on bronchial tree structure information
IEICE Medical Imaging, Naha, Japan, January 2010 (bib)
2009
H. Yano, M. Feuerstein, T. Kitasaka, K. Mori
Study on bronchus region extraction from 3D chest CT images using local intensity structure analysis
18th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, November 2009 (bib)
T. Kugo, M. Feuerstein, T. Kitasaka, K. Mori
A study on construction of respiratory lung motion model for bronchoscope guidance system
18th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, November 2009 (bib)
T. Sugiura, M. Feuerstein, T. Kitasaka, K. Imaizumi, Y. Hasegawa, K. Mori
A study on a method for bronchoscope tracking considering breathing motion by using bronchial structure
18th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, November 2009 (bib)
X. Luo, M. Feuerstein, T. Kitasaka, M. Mori, H. Takabatake, H. Natori, K. Imaizumi, Y. Hasegawa, K. Mori
Improvement of Bronchoscope Tracking by Combining SURF Features Based Camera Motion Estimation and Image Registration
18th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, November 2009 (bib)
H. Yano, D. Deguchi, M. Feuerstein, K. Mori, T. Kitasaka, Y. Suenaga
Study on bronchus region extraction from 3D chest CT images based on analysis of local intensity value distribution
28th Meeting of the Japanese Society of Medical Imaging Technology, Nagoya, Japan, August 2009 (bib)
X. Luo, M. Feuerstein, D. Deguchi, T. Kitasaka, Y. Suenaga, K. Imaizumi, Y. Hasegawa, K. Mori
SIFT Feature-based Motion Estimation for Bronchoscope Tracking
28th Meeting of the Japanese Society of Medical Imaging Technology, Nagoya, Japan, August 2009 (bib)
T. Kugo, M. Feuerstein, K. Mori, T. Kitasaka, Y. Suenaga, Y. Hasegawa, K. Imaizumi, S. Iwano
A preliminary study on making respiratory motion model for bronchoscope guidance system
28th Meeting of the Japanese Society of Medical Imaging Technology, Nagoya, Japan, August 2009 (bib)
H. Yano, M. Feuerstein, T. Kitasaka, K. Mori
Study on bronchus region extraction from 3D chest CT images using local intensity structure analysis and CT value distribution features
Medical Imaging Workshop of the Institute of Electronics, Information and Communication Engineers, Tokyo, Japan, July 2009 (bib)
2008
H. Yano, D. Deguchi, M. Feuerstein, T. Kitasaka, K. Mori, Y. Suenaga
A study on bronchial area extraction from 3D chest CT images using CT value distribution features
17th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, October/November 2008 (bib)
T. Sugiura, D. Deguchi, M. Feuerstein, T. Kitasaka, K. Mori, Y. Suenaga, K. Imaizumi, Y. Hasegawa
A study on a method for accelerating bronchoscope tracking based on image registration on GPU
17th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, October/November 2008 (bib)
X. Luo, M. Feuerstein, D. Deguchi, T. Kitasaka, Y. Suenaga, K. Imaizumi, Y. Hasegawa, K. Mori
A Study on Feature Point Extraction from Bronchoscopic Images for Bronchoscope Tracking
17th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, October/November 2008 (bib)
M. Feuerstein, D. Deguchi, T. Kitasaka, S. Iwano, K. Imaizumi, Y. Hasegawa, Y. Suenaga, K. Mori
Automatic Detection of Mediastinal Lymph Nodes in Contrast-Enhanced Chest CT
17th Meeting of the Japan Society of Computer Assisted Surgery, Tokyo, Japan, October/November 2008 (bib)
2007
M. Feuerstein, T. Mussack, S.M. Heining, N. Navab
Registration-free Laparoscope Superimposition for Intra-Operative Planning of Liver Resection
3rd Russian-Bavarian Conference on Biomedical Engineering, Erlangen, Germany, July 2/3 2007 (bib)
C. Alcérreca, J. Vogel, M. Feuerstein, N. Navab
A New Approach to Ultrasound Guided Radio-Frequency Needle Placement
Bildverarbeitung für die Medizin 2007, Munich, Germany, March 2007 (bib)
2005
J. Traub, S. Wiesner, M. Feuerstein, H. Feußner, N. Navab
Evaluation of Calibration Methods for Laparoscope Augmentation
4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
M. Feuerstein, N. Navab, E.U. Schirmbeck, S.M. Wildhirt, R. Lange, R. Bauernschmitt
Endocsope Augmentation for Port Placement and Navigation for Rigid Anatomy
4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC 2005), Berlin, Germany, September 2005 (bib)
R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, N. Augustin, S.M. Wildhirt, R. Lange
Improvement of Endovascular Stent Grafting by Augmented Reality
Biomedizinische Technik (BMT 2005), Volume 50, Supplementary vol. 1, Part 2, pp. 1262 - 1263, Nuremberg, Germany, September 2005 (bib)

Dissertation

M. Feuerstein
Augmented Reality in Laparoscopic Surgery - New Concepts and Methods for Intraoperative Multimodal Imaging and Hybrid Tracking in Computer Aided Surgery
Book, ISBN 978-3-8364-7783-3, Vdm Verlag Dr. Müller. (bib)
M. Feuerstein
Augmented Reality in Laparoscopic Surgery - New Concepts for Intraoperative Multimodal Imaging
PhD Thesis. The original (high-resolution) publication is available online at mediatum.ub.tum.de (bib)

A trend in abdominal surgery is the transition from open procedures to minimally invasive laparoscopic interventions, where visual feedback to surgical staff is only available through the laparoscope camera and direct palpation of organs is impossible. To successfully perform such sophisticated interventions, the provision of additional intraoperative feedback can be of great help to the surgical staff, especially in complex cases.

This work introduces several new concepts for the application of augmented reality techniques to laparoscopic surgery. One main idea is to utilize multiple intraoperative imaging devices for the acquisition of up-to-date patient data. Optical and electromagnetic tracking systems are applied to determine the position and orientation of both rigid (mobile C-arm, laparoscope) and flexible (laparoscopic ultrasound) imaging devices. The acquired patient data is intrinsically registered to the tracked laparoscope in one common coordinate system, so it can be directly superimposed on the images of the laparoscope camera in real time without intraoperative registration steps. This intuitive superimposition can visually assist and direct the surgeon, as hidden anatomy such as vessels or tumors below the surface of an organ are revealed.

The presented visualization aid can be used during critical phases in the surgical workflow such as port placement and intraoperative resection planning. Whereas superimposition for resection planning is based on intraoperative, implicitly registered imaging data, superimposition for port placement requires an interactive registration of preoperative imaging data to the patient. This interactive process is mostly automated by a newly introduced registration technique that results in a port placement procedure soundly integrated into the current surgical workflow. For resection planning and guidance, where navigated laparoscopic ultrasound can be used to acquire updated images of patient anatomy, a hybrid tracking approach including a method capable of estimating the reliability of electromagnetic tracking data is presented, which is able to automatically notify the surgical staff on possible tracking inaccuracies.

The dissertation bases its validation on many experiments, including animal experiments, performed in close partnership with several surgeons.
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each authors copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Patent Applications

Projects at CAMP

heARt - Heart surgery Enhanced by Augmented Reality Techniques

heARt - Heart surgery Enhanced by Augmented Reality Techniques

Minimally invasive or totally endoscopic cardiac surgery is an operation technique in which physicians operate through small incision points at the operating region, either using endoscopic tools or master-slave robot systems. In either case, the field of view of the physician is quite limited to a small area around the operating region. To get more general overview, preoprative imaging and planning data can be used through Augmented Reality techniques.
PORT - pre-operative planning and intra-operative guidance and navigation for robotically assisted minimally invasive cardiovascular surgery:
- Design of a Planning Tool for Port Placement in Robotically Assisted Minimally Invasive Cardiovascular Surgery (MarcoFeuerstein)
- Design of an Intra-Operative Augmented Reality Navigation Tool for Robotically Assisted Minimally Invasive Cardiovascular Surgery (JoergTraub)
STENT - pre-operative planning and navigation for STENT implantations:
- Development of a Planning and Navigation Tool for Endoscopic Treatment of abdominal Aortic Aneurysms - Computer Supported Implantation of a Stent Graft (MartinGroher)
- Mathematical Methods of Image Processing for Automated Navigation in Endoscopic Treatment of Abdominal Aortic Aneurisms - Computer Aided Implantation of a Stent Graft (PeterKeitler)
The project started in March 2003 and finished in November 2003 as a bundle of diploma theses supervised by Prof. Gudrun Klinker (Fachgebiet Augmented Reality) and Prof. R. Bauernschmitt (German Heart Center). Many of the participants are now working at the Chair for Computer Aided Medical Procedures by Prof. Nassir Navab.
Virtual Mirror: Interaction Paradigm for Augmented Reality Applications

Virtual Mirror: Interaction Paradigm for Augmented Reality Applications

Augmented Reality offers a higher degree of freedom for the programmer than classical visualization of volume data on a screen. The existing paradigms for interaction with 3D objects are not satisfactory for particular applications since the majority of them rotate and move the object of interest. The classic manipulation of virtual objects cannot be used while keeping real and virtual spaces in alignment within an AR environment. This project introduces a simple and efficient interaction paradigm allowing the users to interact with 3D objects and visualize them from arbitrary viewpoints without disturbing the in-situ visualization, or requiring the user to change the viewpoint. We present a virtual, tangible mirror as a new paradigm for interaction with 3D models. The concept borrows its visualization paradigm in some sense from methodology used by dentists to examine the oral cavity without constantly changing their own viewpoint or moving the patients head. The virtual mirror improves the understanding of complex structures, enables completely new concepts to support navigational aid for different tasks and provides the user with intuitive views on physically restricted areas.
Reconstruction and Registration of Histology and Phase Contrast Images for Clinical Validation of Imaging Modalities

Reconstruction and Registration of Histology and Phase Contrast Images for Clinical Validation of Imaging Modalities

Before its introduction into the hospital, a new imaging modality has to be validated. In other words, appearing structures need to be correlated to the imaged tissues. Such a cross validation is only meaningful when performed against the gold standard which is histology. Currently, cross validation is performed by qualitative comparison of 3D datasets to 2D histology slices. Since the acquisition of a consistent 3D histology volume is a challenging task, its comparison to the corresponding dataset always remained qualitative.

The classic histology procedure can be divided in four steps: pre processing, cutting, post processing and imaging of the tissues. In the first step, the sample is chemically processed to preserve the tissues and is then embedded in a paraffin block. By using a microtome, it is cut in very thin slices, and put on a glass slide. During post processing the sample is stained to enhance the structures of interest. The imaging is performed with a camera mounted in a microscope, or with a dedicated scanner. Several difficulties inherent to this process can have a dramatic influence on the quality of the reconstructed histology volume. For instance, since the cutting process is done manually, problems like flipping, bending or ripping of the slides may happen. If the knife starts to wear off, some banding will appear over the slices. Moreover, a few slices could be missing. Finally since the staining color is time dependent, variation in the color of the slices can occur.

In this project, we propose to improve the histology procedure and to develop methods towards a consistent reconstruction of 3D histology volumes.
Endovascular Stenting of Aortic Aneurysms

Endovascular Stenting of Aortic Aneurysms

Endovascular stenting is a minimally invasive treatment technique for aortic aneurysms or dissections. Thereby, a certain aortic prosthesis (stent graft) is placed inside the aortic aneurysm in order to prevent a life-threatening rupture of the aortic wall. Prior to the intervention, a computed tomography angiography (CTA) is acquired on which the surgical staff can measure the parameter of the desired stent graft and finalize the intervention workflow. The entire interventional catheter navigation is done under 2D angiography imaging where the physician is missing the important 3D information. The purpose of our project is two-fold:
1. In the planning phase, a modified graph cuts algorithm automatically segments the aorta and aneurysm, so the surgical staff can choose an appropriate type of stent to match the segmented location, length, and diameter of the aneurysm and aorta. By visualizing the defined stent graft next to the three-dimensionally reconstructed aneurysm, mismeasurements can be detected in an early stage. Our main goal is the creation of an interactive simulation system that predicts the behaviour of the aortic wall and the movement of the implanted stent graft.
2. During implantation of the stent graft, after an intensity based registration of CTA and angiography data, the current navigation can be visualized in the 3D CT data set at any time. This includes solutions for electro-magnetic tracking of catheters as well as guide wires and stent grafts. Eventually, Our main goal is the creation of solutions that enable the surgeon to enhance the accuracy of the navigation and positioning, along with a minimum use of angiography, leading to less radiation exposure and less contrast agent injection.
Real-time fusion of ultrasound and gamma probe for navigated localization of malignancy

Real-time fusion of ultrasound and gamma probe for navigated localization of malignancy

Intra-operative localization of non-superficial cancerous lesions in non-hollow organs like liver, kidney, etc is currently facilitated by intra-operative ultrasound (IOUS) and palpation. This yields a high rate of false positives due to benign abnormal regions and thus unnecessary resections with increased complications and morbidity. In this project we integrate functional nuclear information from gamma probes with IOUS, to provide a synchronized, real-time visualization that facilitates the detection of active tumors and metastases intra-operatively. The bet of this project is that the inclusion of an advanced, augmented visualization provides more reliability and confidence on classifying lesions prior to the resection.
Magneto-Optic Tracking of a Flexible Laparoscopic Ultrasound Transducer

Magneto-Optic Tracking of a Flexible Laparoscopic Ultrasound Transducer

In abdominal surgery, a laparoscopic ultrasound transducer is commonly used to detect lesions such as metastases. The determination and visualization of position and orientation of its flexible tip in relation to the patient or other surgical instruments can be of much help to (novice) surgeons utilizing the transducer intraoperatively. This difficult subject has recently been paid attention to by the scientific community. Electromagnetic tracking systems can be applied to track the flexible tip. However, the magnetic field can be distorted by ferromagnetic material.

We present a new method based on optical tracking of the laparoscope and magneto-optic tracking of the transducer, which is able to automatically detect and correct field distortions. This is used for a smooth augmentation of the B-scan images of the transducer directly on the camera images in real time.
Port Placement in Minimally Invasive Endoscopic Surgery

Port Placement in Minimally Invasive Endoscopic Surgery

Optimal port placement is a delicate issue in minimally invasive endoscopic surgery. A good choice of the instruments' and endoscope's ports can avoid time-consuming consecutive new port placement. We present a novel method to intuitively and precisely plan the port placement. The patient is registered to its pre-operative CT by just moving the endoscope around fiducials, which are attached to the patient's thorax and are visible in its CT. Their 3D positions are automatically reconstructed. Without prior time-consuming segmentation, the pre-operative CT volume is directly rendered with respect to the endoscope or instruments. This enables the simulation of a camera flight through the patient's interior along the instruments' axes to easily validate possible ports.
Laparoscope Augmentation for Minimally Invasive Liver Resection

Laparoscope Augmentation for Minimally Invasive Liver Resection

In recent years, an increasing number of liver tumor indications were treated by minimally invasive laparoscopic resection. Besides the restricted view, a major issue in laparoscopic liver resection is the precise localization of the vessels to be divided. To navigate the surgeon to these vessels, pre-operative imaging data can hardly be used due to intra-operative organ deformations caused by appliance of carbon dioxide pneumoperitoneum and respiratory motion.

Therefore, we propose to use an optically tracked mobile C-arm providing cone-beam computed tomography imaging capability intra-operatively. After patient positioning, port placement, and carbon dioxide insufflation, the liver vessels are contrasted and a 3D volume is reconstructed during patient exhalation. Without any further need for patient registration, the volume can be directly augmented on the live laparoscope video. This augmentation provides the surgeon with essential aid in the localization of veins, arteries, and bile ducts to be divided or sealed.

Current research focuses on the intra-operative use and tracking of mobile C-arms as well as laparoscopic ultrasound, augmented visualization on the laparoscope's view, and methods to synchronize respiratory motion.

Miscellaneous

Work Experience

  • April 2010 - Feb. 2011
    Feodor Lynen Fellow of the Alexander von Humboldt Foundation at the Chair for Computer Aided Medical Procedures and Augmented Reality, Technische Universität München, Germany
  • Jan. 2008 - March 2010
    Postdoctoral Researcher at the Department of Media Science, Graduate School of Information Science, Nagoya University, Japan
  • May 2005 - Nov. 2007
    Research associate at the Chair for Computer Aided Medical Procedures and Augmented Reality, Technische Universität München, Germany
  • Jan. 2004 - April 2005
    Research associate at the Dept. of Cardiothoracic Surgery, German Heart Center Munich, Germany
  • March - July 2002
    Working student in the Function Development Process Department, BMW AG München, Germany
  • Aug. - Dec. 2000
    Internship - Web-Programming (instabus), Siemens AG Singapore, Singapore
  • March/April 2000
    Part time job: Database-Programming, varetis GmbH München, Germany
  • March - Sept. 1999
    Part time job: Web-Design/-Programming, INWEMA AG München, Germany
  • June - Sept. 1998
    Camp Counselor, Indian Lake Camp Burlingham, USA

Education

  • Jan. 2004 - Oct. 2007
    Ph.D. student of Prof. Nassir Navab
  • Oct. 2001 - Dec. 2003
    Technische Universität München: Main study period of Computer science, focus on practical Computer Science, Minor: Architecture
  • Aug./Sept. 2002
    National Taiwan University, Taipei: Internship at the Communication and Multimedia Laboratory of the Department of Computer Science and Information Engineering in 3D computer graphics
  • May - Sept. 2001
    University of Sydney: Interdisciplinary project on Virtual Architecture at the Design Lab
    Submitted Design: M.L. Maher, N. Gu, and M. Feuerstein (2001), Virtual Museum, FEIDAD
  • Jan. - May 2001
    National University of Singapore: Exchange semester at the School of Computing
  • Oct. 1998 - Aug. 2000
    Technische Universität München: Basic study period of Computer Science, Minor: Architecture

Teaching

Summer Term 2007

Winter Term 2006

Summer Term 2006

Winter Term 2005

Summer Term 2005

Winter Term 2004

Summer Term 2004

Theses, SEPs, and IDPs under my Supervision


UsersForm
Title: Dr.
Circumference of your head (in cm):  
Firstname: Marco
Middlename:  
Lastname: Feuerstein
Picture: feuersteinmarcoicon.jpg
Birthday:  
Nationality: Bavaria
Languages: English, German, Bavarian, Japanese
Groups: Registration/Visualization, Segmentation, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality
Expertise: Registration/Visualization, Segmentation, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality
Position: External Collaborator
Status: Alumni
Emailbefore: marco.feuerstein
Emailafter: micro-dimensions.com
Room: microDimensions GmbH
Telephone:  
Alumniactivity: Software Engineer at Lyft
Defensedate: 15 October 2007
Thesistitle: Augmented Reality in Laparoscopic Surgery - New Concepts for Intraoperative Multimodal Imaging
Alumnihomepage:  
Personalvideo01:  
Personalvideotext01:  
Personalvideopreview01:  
Personalvideo02:  
Personalvideotext02:  
Personalvideopreview02:  


Edit | Attach | Refresh | Diffs | More | Revision r1.161 - 30 Oct 2018 - 07:53 - MarcoFeuerstein

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif