 |
Surgical Workflow Analysis in Laparoscopy for Monitoring and DocumentationIn medical collaboration with:Dr. Hubertus Feussner (Klinikum rechts der Isar) Dr. Thomas Mussack (Klinikum Innenstadt) Contact Person(s): Nicolas Padoy |
Abstract
Surgical workflow recovery is a crucial step towards the development of intelligent support systems in surgical environments. The objective of the project is to create a system which is able to recognize automatically the current steps of a surgical laparoscopic procedure using a set of signals recorded from the OR. The project adresses several issues such as the simultaneous recordings of various signals within the OR, the design of methods and algorithms for processing and interpreting the information, and finally the development of a convenient user interface to display context sensitive information inside the OR. The current clinical focus is on laparoscopic cholecystectomies but the concepts developed in the project also apply to laparoscopic surgeries of other kinds.Publications
| 2017 | |
|
R. Stauder, D. Ostler, T. Vogel, D. Wilhelm, S. Koller, M. Kranzfelder, N. Navab
Surgical data processing for smart intraoperative assistance systems Innovative Surgical Sciences, 2(3), 145-152, 2017 (bib) |
|
|
R. Stauder, E. Kayis, N. Navab
Learning-based Surgical Workflow Detection from Intra-Operative Signals arXiv:1706.00587 [cs.LG], 2017 (bib) |
|
|
A. Okur, R. Stauder, H. Feußner, N. Navab
Quantitative Characterization of Components of Computer Assisted Interventions arXiv:1702.00582 [cs.OH], 2017 (bib) |
| 2016 | |
|
|
R. Stauder, D. Ostler, M. Kranzfelder, S. Koller, H. Feußner, N. Navab
The TUM LapChole dataset for the M2CAI 2016 workflow challenge arXiv:1610.09278 [cs.CV], 2016 (bib) |
| 2015 | |
|
|
R. DiPietro?, R. Stauder, E. Kayis, A. Schneider, M. Kranzfelder, H. Feußner, G. D. Hager, N. Navab
Automated Surgical-Phase Recognition Using Rapidly-Deployable Sensors MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), Munich, Germany, October 2015 (bib) |
| 2014 | |
|
|
R. Stauder, A. Okur, N. Navab
Detecting and Analyzing the Surgical Workflow to Aid Human and Robotic Scrub Nurses The 7th Hamlyn Symposium on Medical Robotics, London, UK, July 2014 (bib) |
|
R. Stauder, A. Okur, L. Peter, A. Schneider, M. Kranzfelder, H. Feußner, N. Navab
Random Forests for Phase Detection in Surgical Workflow Analysis The 5th International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), Fukuoka, Japan, June 2014 (bib) |
| 2012 | |
|
|
R. Stauder, V. Belagiannis, L. Schwarz, A. Bigdelou, E. Soehngen, S. Ilic, N. Navab
A User-Centered and Workflow-Aware Unified Display for the Operating Room MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), Nice, France, October 2012 (bib) |
| 2010 | |
| N. Padoy, T. Blum, A. Ahmadi, H. Feußner, M.O. Berger, N. Navab
Statistical Modeling and Recognition of Surgical Workflow Medical Image Analysis (2010), Volume 16, Issue 3, April 2012 (published online December 2010), pp. 632-641. The original publication is available online at www.elsevier.com. (bib) |
|
|
T. Blum, H. Feußner, N. Navab
Modeling and Segmentation of Surgical Workflow from Laparoscopic Video Medical Image Computing and Computer-Assisted Intervention (MICCAI 2010), Beijing, China, September 2010 (bib) |
|
|
T. Blum, N. Navab, H. Feußner
Methods for Automatic Statistical Modeling of Surgical Workflow 7th International Conference on Methods and Techniques in Behavioral Research (Measuring Behavior 2010), Eindhoven, The Netherlands, August 2010 (bib) |
| A. Ahmadi, F. Pisana, E. DeMomi?, N. Navab, G. Ferrigno
User friendly graphical user interface for workflow management during navigated robotic-assisted keyhole neurosurgery Computer Assisted Radiology (CARS), 24th International Congress and Exhibition, Geneva, CH, June 2010 (bib) |
|
| 2009 | |
|
|
N. Padoy, D. Mateus, D. Weinland, M.O. Berger, N. Navab
Workflow Monitoring based on 3D Motion Features ICCV Workshop on Video-oriented Object and Event Classification, Kyoto, Japan, September 2009 (IBM Best Paper Award) (bib) |
| A. Ahmadi, N. Padoy, K. Rybachuk, H. Feußner, S.M. Heining, N. Navab
Motif Discovery in OR Sensor Data with Application to Surgical Workflow Analysis and Activity Detection MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), London, UK, September 2009 (bib) |
|
| A. Ahmadi, T. Klein, N. Navab
Advanced Planning and Ultrasound Guidance for Keyhole Neurosurgery in ROBOCAST Russian Bavarian Conference (RBC), Munich, GER, July 2009 (bib) |
|
| A. Ahmadi, T. Klein, N. Navab, R. Roth, R.R. Shamir, L. Joskowicz, E. DeMomi?, G. Ferrigno, L. Antiga, R.I. Foroni
Advanced Planning and Intra-operative Validation for Robot-Assisted Keyhole Neurosurgery In ROBOCAST International Conference on Advanced Robotics (ICAR), Munich, GER, June 2009 (bib) |
|
| 2008 | |
|
|
T. Blum, N. Padoy, H. Feußner, N. Navab
Workflow Mining for Visualization and Analysis of Surgeries International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 5, November 2008, pp. 379-386. The original publication is available online at www.springerlink.com. (bib) |
| A. Ahmadi, N. Padoy, S.M. Heining, H. Feußner, M. Daumer, N. Navab
Introducing Wearable Accelerometers in the Surgery Room for Activity Detection 7. Jahrestagung der Deutschen Gesellschaft f{\"u}r Computer-und Roboter-Assistierte Chirurgie (CURAC 2008) (bib) |
|
|
|
T. Blum, N. Padoy, H. Feußner, N. Navab
Modeling and Online Recognition of Surgical Phases using Hidden Markov Models Medical Image Computing and Computer-Assisted Intervention (MICCAI 2008), New York, USA, September 2008, pp. 627-635. The original publication is available online at www.springerlink.com. (bib) |
|
|
N. Padoy, T. Blum, H. Feußner, M.O. Berger, N. Navab
On-line Recognition of Surgical Activity for Monitoring in the Operating Room Proceedings of the 20th Conference on Innovative Applications of Artificial Intelligence (IAAI 2008) held in conjunction with the 23rd AAAI Conference on Artificial Intelligence, Chicago, Illinois, USA, July 2008, pp. 1718-1724 (bib) |
| U.F. Klank, N. Padoy, H. Feußner, N. Navab
An Automatic Approach for Feature Generation in Endoscopic Images International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 3-4, Saptember 2008, pp. 331-339 (bib) |
|
|
|
T. Blum, N. Padoy, H. Feußner, N. Navab
Workflow Mining for Visualization and Analysis of Surgeries Proceedings of Computer Assisted Radiology and Surgery (CARS 2008), Barcelona, Spain, June 2008, pp. 134-135 (bib) |
| 2007 | |
|
|
N. Padoy, T. Blum, I. Essa, H. Feußner, M.O. Berger, N. Navab
A Boosted Segmentation Method for Surgical Workflow Analysis Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 2007, pp. 102-109. The original publication is available online at www.springerlink.com. (bib) |
|
|
N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier
Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib) |
| N. Padoy, M. Horn, H. Feußner, M.O. Berger, N. Navab
Recovery of Surgical Workflow: a Model-based Approach Proceedings of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, June 2007 (bib) |
|
|
|
T. Sielhorst, R. Stauder, M. Horn, T. Mussack, A. Schneider, H. Feußner, N. Navab
Simultaneous replay of automatically synchronized videos of surgeries for feedback and visual assessment Journal of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, Volume 2, Supplement 1, pp. 433-434 (bib) |
|
|
T. Blum, T. Sielhorst, N. Navab
Advanced Augmented Reality Feedback for Teaching 3D Tool Manipulation New Technology Frontiers in Minimally Invasive Therapies, 2007, pp. 223-236 (bib) |
| 2006 | |
|
|
A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feußner, N. Navab
Recovery of surgical workflow without explicit models Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 420-428 (bib) |
| 2005 | |
|
|
T. Sielhorst, T. Blum, N. Navab
Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Austria, October 2005, pp. 38-47. The original publication is available online at ieee.org. (bib) |
Team
Contact Person(s)
|
Working Group
|
|
|
|
|
|
|
Alumni
|
|
|
|
|
|
Location
 |
Technische Universität München Institut für Informatik / I16 Boltzmannstr. 3 85748 Garching bei München Tel.: +49 89 289-17058 Fax: +49 89 289-17059 |
 |
 |
Ludwig-Maximilians-Universität München Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS Nussbaumstr. 20 80336 München Room: C2.06 Tel.: +49 89 5160-3615 Tel.: +49 89 5160-3635 Fax: +49 89 5160-3630 |
|
 |
Klinikum rechts der Isar der Technischen Universitüt München Ismaninger Str. 22 81675 München IFL Lab - Room: 01.3a-c Tel.: +49 89 4140-6457 Fax: +49 89 4140-6458 |
|
internal project page
Please contact Nicolas Padoy for available student projects within this research project.
