Intra-operative Human Computer Interaction and Usability Evaluations In medical collaboration with: Prof. Dr. Markus Schwaiger, Chefarzt, Nuklearmedicine, Klinikum rechts der Isar, TUM, Munich, Germany Prof. Dr. Klemens Scheidhauer, Oberarzt, Nuklearmedicine, Klinikum rechts der Isar, TUM, Munich, Germany Prof. Dr. Marion Kiechle, Chefarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany Dr. Stefan Paepke, Leitender Oberarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany Dr. Andreas Schnelzer, Oberarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany Scientific Director: Nassir Navab Contact Person(s): Asli Okur and Ralf Stauder In industrial collaboration with: Dr. Joerg Traub, CEO, SurgicEye GmbH, Munich, Germany Dr. Thomas Wendler, CTO, SurgicEye GmbH, Munich, Germany

Keywords: Surgical Workflow, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality, 3D Interaction, IFL

Abstract

Computerized medical systems play a vital role in the operating room, yet surgeons often face challenges when interacting with these systems during surgery. In this project we are aiming at analyzing and understanding the Operating Room specific aspects which affect the end user experience. Beside operating room specific usability evaluation approaches in this project we also try to improve the preliminary intra-operative user interaction methodologies.

Detailed Project Description

Evaluating the usability of systems in complex domains like the Operating Room is not an easy endeavor. In order to handle the complexity, deep domain knowledge is required. In this project we have proposed an operating room specific domain model. This model is used to facilitate the state of art usability engineering approaches in the operating theater. Furthermore, the proposed domain model is base of our studies for developing a novel and extensible intra-operative human computer interaction framework. This open framework supports wide range of input sensors and can be extended to be used with computerized systems in the operating theater.

Videos

Publications

2012
	A. Bigdelou, L. Schwarz, T. Benz, N. Navab A Flexible Platform for Developing Context-Aware 3D Gesture-based Interfaces International ACM Conference on Intelligent User Interfaces (IUI), Lissabon, Portugal, February 2012 (bib)
	A. Bigdelou, L. Schwarz, N. Navab An Adaptive Solution for Intra-operative Gesture-based Human-Machine Interaction International ACM Conference on Intelligent User Interfaces (IUI), Lissabon, Portugal, February 2012 (bib)
	A. Bigdelou, T. Benz, L. Schwarz, N. Navab Customizable Gesturing Interface for the Operating Room using Kinect ChaLearn Gesture Challenge, CVPR Workshop on Gesture Recognition, Providence, Rhode Island, June 2012 (bib)
	A. Bigdelou, R. Stauder, T. Benz, A. Okur, T. Blum, R. Ghotbi, N. Navab HCI Design in the OR: A Gesturing Case-study MICCAI 2012 Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), Nice, France, October 2012 (bib)
	A. Bigdelou, A. Okur, M.-E. Hoffmann, B. Azizi, N. Navab Towards systematic usability evaluations for the OR: an introduction to OR-Use framework Information Processing in Computer Assisted Interventions (IPCAI), Pisa, Italy, June 27, 2012 (bib)
	A. Bigdelou, A. Katouzian, N. Navab Model-based visualization of usability data to support analysis in complex domains 21th International Conference of Usability Professionals Association (UPA), Henderson, Nevada, USA, June 2012 (bib)
	A. Bigdelou, T. Benz, L. Schwarz, N. Navab Simultaneous Categorical and Spatio-Temporal 3D Gestures Using Kinect IEEE Symposium on 3D User Interfaces (3DUI), Orange County, CA, March 2012 (bib)
2011
	A. Okur, A. Ahmadi, A. Bigdelou, T. Wendler, N. Navab MR in OR: First analysis of AR/VR visualization in 100 intra-operative Freehand SPECT acquisitions The 10th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, Oct. 26 - 29, 2011. (bib)
	A. Bigdelou, T. Sterner, S. Wiesner, T. Wendler, F. Matthes, N. Navab OR Specific Domain Model for Usability Evaluations of Intra-Operative Systems Information Processing in Computer Assisted Interventions (IPCAI), Berlin (DE), June 22, 2011 (bib)
	L. Schwarz, A. Bigdelou, N. Navab Learning Gestures for Customizable Human-Computer Interaction in the Operating Room Medical Image Computing and Computer Assisted Intervention (MICCAI), Toronto, Canada, September 2011 (bib)

Team

Contact Person(s)

Dr. Aslı Okur Kuru

Dipl.-Inf. Univ. Ralf Stauder

Working Group

Dr. Aslı Okur Kuru

Max-Emanuel Hoffmann

Prof. Dr. Nassir Navab

Dipl.-Inf. Univ. Ralf Stauder

Alumni

Dr. Ali Bigdelou

Bamshad Azizi

Dr. Loren Schwarz

Location

Technische Universität München Institut für Informatik / I16 Boltzmannstr. 3 85748 Garching bei München Tel.: +49 89 289-17058 Fax: +49 89 289-17059

Visit our lab at Garching.

Klinikum rechts der Isar der Technischen Universitüt München Ismaninger Str. 22 81675 München IFL Lab - Room: 01.3a-c Tel.: +49 89 4140-6457 Fax: +49 89 4140-6458

Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Asli Okur and Ralf Stauder for available student projects within this research project.