ProjectCAOP

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

ProjectCAOP

Computer-Aided Ophthalmic Procedures

Computer-Aided Ophthalmic Procedures

Scientific Director:
Prof. Dr. Nassir Navab

Contact Person(s):
Nicola Rieke

In industrial collaboration with:
Carl Zeiss MEDITEC

Keywords: Registration / Visualization, Segmentation, Medical Imaging, Computer-Aided Surgery, Computer-aided Interventions, Computer Vision, Medical Augmented Reality, Machine Learning for Medical Applications

Abstract

In the current workflow of opthamologic surgeries, the surgeon observes the scene in an indirect way through a microscope while performing the surgery with the necessary high handling precision. During membrane peeling, for example, the surgeon has to grasp an anatomical layer of only 10 μm off the retina without damaging it. However, under this limited microscopic view, it becomes very challenging to infer the distance of the surgical instrument to the retina. Issues such as lens distortion, high level of blurriness and lack of haptic feedback complicate the task further. Recently, an intraoperative version of the Optical Coherence Tomography (OCT) was introduced, which provides the 3D information along a scanning line. On the one hand, this modality provides depth information during the surgery. On the other hand, the device has to be manually positioned to the region of interest which further complicates the current workflow of the surgeon (who already has to manipulate the surgical tool, the handheld light source and the microscope). The main goal of the project is support the surgeon in the current workflow and provide additional information during the surgery via advanced computer vision, visualization and augmented reality algorithms.

Pictures

Figure 1: Typical testing setup
Figure 2: Presenting a visualization prototype to the surgeon

Publications

2017
I. Laina, N. Rieke, C. Rupprecht, J. Page Vizcaino, A. Eslami, F. Tombari, N. Navab
Concurrent Segmentation and Localization for Tracking of Surgical Instruments
Accepted to Proceedings of the 20th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), Quebec, Canada, September 2017.
A pre-print version is available online at arXiv.
The first two authors contribute equally to this paper.
(bib)
J. Page Vizcaino, N. Rieke, D. J. Tan , F. Tombari, A. Eslami, N. Navab
Automatic Initialization and Failure Detection for Surgical Tool Tracking in Retinal Microsurgery
Workshops Bildverarbeitung fuer die Medizin (BVM), Heidelberg, March 12-14, 2017. (bib)
2016
H. Roodaki, C. Amat di San Filippo, D. Zapp, A. Eslami, N. Navab
A Surgical Guidance System for Big-Bubble Deep Anterior Lamellar Keratoplasty
Proceedings of the 19th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), Athens, Greece, October 2016 (bib)
N. Rieke, D. J. Tan , F. Tombari, J. Page Vizcaino, C. Amat di San Filippo, A. Eslami, N. Navab
Real-Time Online Adaption for Robust Instrument Tracking and Pose Estimation
Proceedings of the 19th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), Athens, Greece, October 2016 (bib)
N. Rieke, D. J. Tan , C. Amat di San Filippo, F. Tombari, M. Alsheakhali, V. Belagiannis, A. Eslami, N. Navab
Real-time Localization of Articulated Surgical Instruments in Retinal Microsurgery
Medical Image Analysis, vol. 34, 82-100, 2016. The original publication is available online at medicalimageanalysisjournal.com. A free version is available until November 17,2016 (bib)
N. Rieke, A. Eslami, N. Navab
Automatic iOCT Positioning During Membrane Peeling via Real-time High Resolution Surgical Forceps Tracking
Proc. of International Society of Imaging in the Eye Conference, Association for Research in Vision and Ophthalmology (ARVO), Seattle, USA, April 2016 (bib)
M. Alsheakhali, A. Eslami, N. Navab
Detection of Articulated Instruments in Retinal Microsurgery
Proceedings of International Symposium on Biomedical Imaging (ISBI), April 2016, Prague, Czech Republic (bib)
2015
N. Rieke, D. J. Tan , M. Alsheakhali, F. Tombari, C. Amat di San Filippo, V. Belagiannis, A. Eslami, N. Navab
Surgical Tool Tracking and Pose Estimation in Retinal Microsurgery
Proceedings of the 18th International Conference on Medical Image Computing and Computer Assisted Interventions (MICCAI), Munich, Germany, October 2015 (bib)
M. Alsheakhali, A. Eslami, N. Navab
Microscopic Surgical Tool Type Detection
Proceedings of MICCAI Workshop on Interventional Microscopy (IM), October. 2015, Munich, Germany (bib)
H. Roodaki, K. Filippatos, A. Eslami, N. Navab
Introducing Augmented Reality to Optical Coherence Tomography in Ophthalmic Microsurgery
International Symposium on Mixed and Augmented Reality (ISMAR), 2015 (bib)
M. Alsheakhali, M. Yigitsoy, A. Eslami, N. Navab
Real Time Medical Instrument Detection and Tracking in Microsurgery
Bildverarbeitung für die Medizin, March. 2015, Lübeck, Germany (bib)
M. Alsheakhali, M. Yigitsoy, A. Eslami, N. Navab
Surgical Tool Detection and Tracking in Retinal Microsurgery
SPIE, Feb. 2015, Orlando, Florida, USA. (bib)

Team

Contact Person(s)

Nicola Rieke
Nicola Rieke

Working Group

David Tan
David Tan
Federico Tombari
Dr. Federico Tombari
Hessam Roodaki
Hessam Roodaki
Jakob Weiss
Jakob Weiss
Mohamed Alsheakhali
M.Sc. Mohamed Alsheakhali
Nicola Rieke
Nicola Rieke

Location



Technische Universität München
Institut für Informatik / I16
Boltzmannstr. 3
85748 Garching bei München

Tel.: +49 89 289-17058
Fax: +49 89 289-17059
Visit our lab at Garching.



internal project page

Please contact
Nicola Rieke for available student projects within this research project.

Edit | Attach | Refresh | Diffs | More | Revision r1.1 - 26 Sep 2016 - 15:46 - NicolaRieke

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif