ProjectWorkflowLaparoscopy

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Surgical Workflow Analysis in Laparoscopy for Monitoring and Documentation

Surgical Workflow Analysis in Laparoscopy for Monitoring and Documentation

In medical collaboration with:
Dr. Hubertus Feussner (Klinikum rechts der Isar)
Dr. Thomas Mussack (Klinikum Innenstadt)

Contact Person(s): Nicolas Padoy

Keywords: Surgical Workflow, Past Projects

Abstract

Surgical workflow recovery is a crucial step towards the development of intelligent support systems in surgical environments. The objective of the project is to create a system which is able to recognize automatically the current steps of a surgical laparoscopic procedure using a set of signals recorded from the OR. The project adresses several issues such as the simultaneous recordings of various signals within the OR, the design of methods and algorithms for processing and interpreting the information, and finally the development of a convenient user interface to display context sensitive information inside the OR. The current clinical focus is on laparoscopic cholecystectomies but the concepts developed in the project also apply to laparoscopic surgeries of other kinds.

Publications

2014
R. Stauder, A. Okur, N. Navab
Detecting and Analyzing the Surgical Workflow to Aid Human and Robotic Scrub Nurses
The 7th Hamlyn Symposium on Medical Robotics, London, UK, July 2014 (bib)
R. Stauder, A. Okur, L. Peter, A. Schneider, M. Kranzfelder, H. Feußner, N. Navab
Random Forests for Phase Detection in Surgical Workflow Analysis
The 5th International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), Fukuoka, Japan, June 2014 (bib)
2012
R. Stauder, V. Belagiannis, L. Schwarz, A. Bigdelou, E. Soehngen, S. Ilic, N. Navab
A User-Centered and Workflow-Aware Unified Display for the Operating Room
MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), Nice, France, October 2012 (bib)
2010
N. Padoy, T. Blum, A. Ahmadi, H. Feußner, M.O. Berger, N. Navab
Statistical Modeling and Recognition of Surgical Workflow
Medical Image Analysis (2010), Volume 16, Issue 3, April 2012 (published online December 2010), pp. 632-641. The original publication is available online at www.elsevier.com. (bib)
T. Blum, H. Feußner, N. Navab
Modeling and Segmentation of Surgical Workflow from Laparoscopic Video
Medical Image Computing and Computer-Assisted Intervention (MICCAI 2010), Beijing, China, September 2010 (bib)
T. Blum, N. Navab, H. Feußner
Methods for Automatic Statistical Modeling of Surgical Workflow
7th International Conference on Methods and Techniques in Behavioral Research (Measuring Behavior 2010), Eindhoven, The Netherlands, August 2010 (bib)
A. Ahmadi, F. Pisana, E. DeMomi?, N. Navab, G. Ferrigno
User friendly graphical user interface for workflow management during navigated robotic-assisted keyhole neurosurgery
Computer Assisted Radiology (CARS), 24th International Congress and Exhibition, Geneva, CH, June 2010 (bib)
2009
N. Padoy, D. Mateus, D. Weinland, M.O. Berger, N. Navab
Workflow Monitoring based on 3D Motion Features
ICCV Workshop on Video-oriented Object and Event Classification, Kyoto, Japan, September 2009 (IBM Best Paper Award) (bib)
A. Ahmadi, N. Padoy, K. Rybachuk, H. Feußner, S.M. Heining, N. Navab
Motif Discovery in OR Sensor Data with Application to Surgical Workflow Analysis and Activity Detection
MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), London, UK, September 2009 (bib)
A. Ahmadi, T. Klein, N. Navab
Advanced Planning and Ultrasound Guidance for Keyhole Neurosurgery in ROBOCAST
Russian Bavarian Conference (RBC), Munich, GER, July 2009 (bib)
A. Ahmadi, T. Klein, N. Navab, R. Roth, R.R. Shamir, L. Joskowicz, E. DeMomi?, G. Ferrigno, L. Antiga, R.I. Foroni
Advanced Planning and Intra-operative Validation for Robot-Assisted Keyhole Neurosurgery In ROBOCAST
International Conference on Advanced Robotics (ICAR), Munich, GER, June 2009 (bib)
2008
T. Blum, N. Padoy, H. Feußner, N. Navab
Workflow Mining for Visualization and Analysis of Surgeries
International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 5, November 2008, pp. 379-386. The original publication is available online at www.springerlink.com. (bib)
A. Ahmadi, N. Padoy, S.M. Heining, H. Feußner, M. Daumer, N. Navab
Introducing Wearable Accelerometers in the Surgery Room for Activity Detection
7. Jahrestagung der Deutschen Gesellschaft f{\"u}r Computer-und Roboter-Assistierte Chirurgie (CURAC 2008) (bib)
T. Blum, N. Padoy, H. Feußner, N. Navab
Modeling and Online Recognition of Surgical Phases using Hidden Markov Models
Medical Image Computing and Computer-Assisted Intervention (MICCAI 2008), New York, USA, September 2008, pp. 627-635. The original publication is available online at www.springerlink.com. (bib)
N. Padoy, T. Blum, H. Feußner, M.O. Berger, N. Navab
On-line Recognition of Surgical Activity for Monitoring in the Operating Room
Proceedings of the 20th Conference on Innovative Applications of Artificial Intelligence (IAAI 2008) held in conjunction with the 23rd AAAI Conference on Artificial Intelligence, Chicago, Illinois, USA, July 2008, pp. 1718-1724 (bib)
U.F. Klank, N. Padoy, H. Feußner, N. Navab
An Automatic Approach for Feature Generation in Endoscopic Images
International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 3-4, Saptember 2008, pp. 331-339 (bib)
T. Blum, N. Padoy, H. Feußner, N. Navab
Workflow Mining for Visualization and Analysis of Surgeries
Proceedings of Computer Assisted Radiology and Surgery (CARS 2008), Barcelona, Spain, June 2008, pp. 134-135 (bib)
2007
N. Padoy, T. Blum, I. Essa, H. Feußner, M.O. Berger, N. Navab
A Boosted Segmentation Method for Surgical Workflow Analysis
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 2007, pp. 102-109. The original publication is available online at www.springerlink.com. (bib)
N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier
Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures
IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
N. Padoy, M. Horn, H. Feußner, M.O. Berger, N. Navab
Recovery of Surgical Workflow: a Model-based Approach
Proceedings of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, June 2007 (bib)
T. Sielhorst, R. Stauder, M. Horn, T. Mussack, A. Schneider, H. Feußner, N. Navab
Simultaneous replay of automatically synchronized videos of surgeries for feedback and visual assessment
Journal of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, Volume 2, Supplement 1, pp. 433-434 (bib)
T. Blum, T. Sielhorst, N. Navab
Advanced Augmented Reality Feedback for Teaching 3D Tool Manipulation
New Technology Frontiers in Minimally Invasive Therapies, 2007, pp. 223-236 (bib)
2006
A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feußner, N. Navab
Recovery of surgical workflow without explicit models
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 420-428 (bib)
2005
T. Sielhorst, T. Blum, N. Navab
Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions
Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Austria, October 2005, pp. 38-47. The original publication is available online at ieee.org. (bib)

Team

Contact Person(s)

Nicolas Padoy
Dr. Nicolas Padoy

Working Group

Ahmad Ahmadi
Dr. Ahmad Ahmadi
Armin Schneider
M.Sc. Armin Schneider
Hubertus Feussner
Prof. Dr. Hubertus Feussner
Nassir Navab
Prof. Dr. Nassir Navab
Nicolas Padoy
Dr. Nicolas Padoy
Thomas Mussack
Prof. Dr. Thomas Mussack
Tobias Blum
Dr. Tobias Blum

Alumni

Daniel Butnaru
Daniel Butnaru
Michael Bothmann
Michael Bothmann
Ralf Stauder
Dipl.-Inf. Univ. Ralf Stauder
Tobias Sielhorst
Dr. Tobias Sielhorst
Uli Klank
Uli Klank
Yury Oleynik
Yury Oleynik

Location



Technische Universität München
Institut für Informatik / I16
Boltzmannstr. 3
85748 Garching bei München

Tel.: +49 89 289-17058
Fax: +49 89 289-17059
Visit our lab at Garching.



Ludwig-Maximilians-Universität München
Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS
Nussbaumstr. 20
80336 München

Room: C2.06
Tel.: +49 89 5160-3615
Tel.: +49 89 5160-3635
Fax: +49 89 5160-3630
Visit our lab at Klinikum Innenstadt.



Klinikum rechts der Isar
der Technischen Universitüt München
Ismaninger Str. 22
81675 München

IFL Lab - Room: 01.3a-c
Tel.: +49 89 4140-6457
Fax: +49 89 4140-6458
Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Nicolas Padoy for available student projects within this research project.

Edit | Attach | Refresh | Diffs | More | Revision r1.1 - 18 Sep 2007 - 14:15 - NicolasPadoy

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif