ProjectInteroperativeUsability

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Intra-operative Human Computer Interaction and Usability Evaluations

Intra-operative Human Computer Interaction and Usability Evaluations

In medical collaboration with:
Prof. Dr. Markus Schwaiger, Chefarzt, Nuklearmedicine, Klinikum rechts der Isar, TUM, Munich, Germany
Prof. Dr. Klemens Scheidhauer, Oberarzt, Nuklearmedicine, Klinikum rechts der Isar, TUM, Munich, Germany
Prof. Dr. Marion Kiechle, Chefarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany
Dr. Stefan Paepke, Leitender Oberarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany
Dr. Andreas Schnelzer, Oberarzt, Gynaecology, Klinikum rechts der Isar, TUM, Munich, Germany

Scientific Director: Nassir Navab

Contact Person(s): Asli Okur and Ralf Stauder

In industrial collaboration with:
Dr. Joerg Traub, CEO, SurgicEye GmbH, Munich, Germany
Dr. Thomas Wendler, CTO, SurgicEye GmbH, Munich, Germany

Keywords: Surgical Workflow, Medical Imaging, Computer-Aided Surgery, Medical Augmented Reality, 3D Interaction, IFL

Abstract

Computerized medical systems play a vital role in the operating room, yet surgeons often face challenges when interacting with these systems during surgery. In this project we are aiming at analyzing and understanding the Operating Room specific aspects which affect the end user experience. Beside operating room specific usability evaluation approaches in this project we also try to improve the preliminary intra-operative user interaction methodologies.

Detailed Project Description

Evaluating the usability of systems in complex domains like the Operating Room is not an easy endeavor. In order to handle the complexity, deep domain knowledge is required. In this project we have proposed an operating room specific domain model. This model is used to facilitate the state of art usability engineering approaches in the operating theater. Furthermore, the proposed domain model is base of our studies for developing a novel and extensible intra-operative human computer interaction framework. This open framework supports wide range of input sensors and can be extended to be used with computerized systems in the operating theater.

Videos

Publications

2012
A. Bigdelou, L. Schwarz, T. Benz, N. Navab
A Flexible Platform for Developing Context-Aware 3D Gesture-based Interfaces
International ACM Conference on Intelligent User Interfaces (IUI), Lissabon, Portugal, February 2012 (bib)
A. Bigdelou, L. Schwarz, N. Navab
An Adaptive Solution for Intra-operative Gesture-based Human-Machine Interaction
International ACM Conference on Intelligent User Interfaces (IUI), Lissabon, Portugal, February 2012 (bib)
A. Bigdelou, T. Benz, L. Schwarz, N. Navab
Customizable Gesturing Interface for the Operating Room using Kinect
ChaLearn Gesture Challenge, CVPR Workshop on Gesture Recognition, Providence, Rhode Island, June 2012 (bib)
A. Bigdelou, R. Stauder, T. Benz, A. Okur, T. Blum, R. Ghotbi, N. Navab
HCI Design in the OR: A Gesturing Case-study
MICCAI 2012 Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), Nice, France, October 2012 (bib)
A. Bigdelou, A. Okur, M.-E. Hoffmann, B. Azizi, N. Navab
Towards systematic usability evaluations for the OR: an introduction to OR-Use framework
Information Processing in Computer Assisted Interventions (IPCAI), Pisa, Italy, June 27, 2012 (bib)
A. Bigdelou, A. Katouzian, N. Navab
Model-based visualization of usability data to support analysis in complex domains
21th International Conference of Usability Professionals Association (UPA), Henderson, Nevada, USA, June 2012 (bib)
A. Bigdelou, T. Benz, L. Schwarz, N. Navab
Simultaneous Categorical and Spatio-Temporal 3D Gestures Using Kinect
IEEE Symposium on 3D User Interfaces (3DUI), Orange County, CA, March 2012 (bib)
2011
A. Okur, A. Ahmadi, A. Bigdelou, T. Wendler, N. Navab
MR in OR: First analysis of AR/VR visualization in 100 intra-operative Freehand SPECT acquisitions
The 10th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, Oct. 26 - 29, 2011. (bib)
A. Bigdelou, T. Sterner, S. Wiesner, T. Wendler, F. Matthes, N. Navab
OR Specific Domain Model for Usability Evaluations of Intra-Operative Systems
Information Processing in Computer Assisted Interventions (IPCAI), Berlin (DE), June 22, 2011 (bib)
L. Schwarz, A. Bigdelou, N. Navab
Learning Gestures for Customizable Human-Computer Interaction in the Operating Room
Medical Image Computing and Computer Assisted Intervention (MICCAI), Toronto, Canada, September 2011 (bib)

Team

Contact Person(s)

Aslı Okur Kuru
Dipl.-Inf. Univ. Aslı Okur Kuru
Ralf Stauder
Dipl.-Inf. Univ. Ralf Stauder

Working Group

Aslı Okur Kuru
Dipl.-Inf. Univ. Aslı Okur Kuru
Max-Emanuel Hoffmann
Max-Emanuel Hoffmann
Nassir Navab
Prof. Dr. Nassir Navab
Ralf Stauder
Dipl.-Inf. Univ. Ralf Stauder

Alumni

Ali Bigdelou
Dr. Ali Bigdelou
Bamshad Azizi
Bamshad Azizi
Loren Schwarz
Dr. Loren Schwarz

Location



Technische Universität München
Institut für Informatik / I16
Boltzmannstr. 3
85748 Garching bei München

Tel.: +49 89 289-17058
Fax: +49 89 289-17059
Visit our lab at Garching.



Klinikum rechts der Isar
der Technischen Universitüt München
Ismaninger Str. 22
81675 München

IFL Lab - Room: 01.3a-c
Tel.: +49 89 4140-6457
Fax: +49 89 4140-6458
Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Asli Okur and Ralf Stauder for available student projects within this research project.

Edit | Attach | Refresh | Diffs | More | Revision r1.3 - 12 Sep 2011 - 10:36 - AsliOkur

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif