TeachingSs12SeminarMedARUI

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Proseminar - Medical Augmented Reality und User Interfaces

Tobias Blum, Ali Bigdelou, Ralf Stauder, Nassir Navab

Module: IN0013 (2 SWS, 4 ECTS Credits)
Programs: Informatics (Bachelor & Diploma), Wirtschaftsinformatik/Information Systems (Bachelor), Naturwissenschaftliche Bildung (Bachelor)

Time: Monday, 16:30 - 18:30
Location: MI 03.13.010

Content

Augmented Reality (AR) is a research topic that is currently obtaining a lot of attention and media coverage. While the current AR hype is mainly due to AR on mobile devices, there is a long history of AR applications for industrial and medical use. Especially in the medical domain, the idea of using AR to have a "x-ray"-view into the patient e.g. during a running surgery is very appealing and would bring a lot of benefits to surgeons. In this seminar the most important technologies, issues and applications of medical AR are covered. Different display and tracking technologies, issues like registration and depth perception and a range of applications will be discussed in detail. Another related topic is user interfaces for medical applications. There is an increasing number of devices and information in the OR. On one side this has a lot of advantages for the surgeon, on the other side the surgeon has to handle many devices and has to process all the information. Furthermore interaction with devices is difficult as the surgeon has to be sterile and can not use mouse and keyboard. So there is an increasing interest in novel user interfaces using e.g. gestures.

HMD

Motivation

Joergs foot susu gestures
Live AR visualization of a CT dataset on the foot of a patient AR visualization of a CT dataset on the head of a patient Gesture based user interface

Requirements

In this Bachelor Seminar Course (Proseminar), each student is asked to present one topic related to medical augmented reality and user interfaces. In order to successfully complete the seminar, participants are required to:

  • Present the selected subject to the other participants (30 minutes, followed by a short discussion).
  • Submit a written report (10 pages content maximum), typeset in LaTeX, and participate in the reviewing process
  • Attend all seminar sessions and participate.

Each presentation is followed by a discussion and everyone is encouraged to actively participate. The report must include all references used and must be written completely in your own words.


Schedule

Date — Datum Room
Monday, April 16, 16:30 Initial meeting, Slides MI 03.13.010
Monday, April 30, 23:59 (PST) Submission deadline of literature list and outline to supervisor, via e-mail to your supervisor  
Monday, May 14, 23:59 (PST) Submission deadline of preliminary version of your report, in electronic form via e-mail to your supervisor  
Assignment of two such reports of fellow students for reviewing, by e-mail from your supervisor  
Monday, May 21, 23:59 (PST) Submission of reviews  
Delivery of two student reviews and one supervisor review per participant, via e-mail from your supervisor  
Monday, June 4, 16:30 Ton Nu Cam, Mai: History of medical AR MI 03.13.010
  Enzinger, Martin: Tracking technologies  
  Schwister, Andreas: AR display devices  
Monday, June 11, 16:30 Nguyen, Dinh Hung-Anh: Computer Graphics for Medical AR MI 03.13.010
  Teplizki, Stanislav: Perception in Medical AR  
  Vornhülz, Jan: Stereo displays  
Monday, June 18, 16:30 Maul, Philipp: Skeleton tracking MI 03.13.010
  Li, Rongbiao: 3D Graphics using Multitouch  
  Gheorghe, Corina: Treatment of phobias using AR/VR  
Monday, June 25, 16:30 Gerö, Andreas: Software Architectures MI 03.13.010
  Nguyen, Duc: Gesture-based interaction using Kinect  
  Schultheiß, Manuel: Speech recognition  
Monday, July 16, 23:59 (PST) Submission deadline of final reports, per e-mail to your supervisor  

Open & Reserved Topics

you can also propose your own topic
  • History of medical AR
  • AR Display devices
  • AR for training and education in medicine
  • Perception in medical AR
  • Computer Graphics for Medical AR
  • Tracking technologies
  • Stereo displays
  • Human Skeleton Tracking for User Interfaces
  • Speech recognition in the OR
  • User interfaces for 3D interaction
  • Treatment of phobias using AR/VR
  • Software Architectures and Frameworks for Multi-modal User Interaction
  • Usability Evaluations for Augmented Reality Applications
  • Gesture-based interaction using Kinect
  • Gesture-based interaction using Inertial Sensors
  • Gesture-based interaction using Gloves
  • Interactive 3D Graphics using Multitouch Screens
  • Interactions with Large Displays
  • Layout of items in video walls and large displays

Essay/Talk

Presentation (about 30-45min) followed by a discussion. Essay (10 pages) including all references used. The essay and presentation have to be done in English for Hauptseminars and German or English for Proseminars. The essay must be written in your own words and not by copy and paste.

For Windows users:

Your talk:

Literature and Helpful Links

A lot of scientific publications can be found online.

The following list may help you to find some further information on your particular topic:

Some publishers:

Libraries (online and offline):

Some further hints for working with references:

  • JabRef is a Java program for comfortable working with Bibtex literature databases. Handy feature: if you know the PubMed ID for an article, JabRef can import data from there (via "Web Search/Medline").
  • Mendeley is a cross-platform program for organising your references.

If you find useful resources that are not already listed here, please tell us, so we can add them for others. Thanks.


TeachingForm
Title: Medical Augmented Reality und User Interfaces
Professor: Prof. Dr. Nassir Navab
Tutors: Tobias Blum, Ali Bigdelou, Ralf Stauder
Type: Proseminar
Information: 2 SWS, 4 ECTS Credits (Module IN0013)
Term: 2012SoSe
Abstract: Augmented Reality (AR) is a research topic that is currently obtaining a lot of attention and media coverage. While the current AR hype is mainly due to AR on mobile devices, there is a long history of AR applications for industrial and medical use. Especially in the medical domain, the idea of using AR to have a "x-ray"-view into the patient e.g. during a running surgery is very appealing and would bring a lot of benefits to surgeons. In this seminar the most important technologies, issues and applications of medical AR are covered. Different display and tracking technologies, issues like registration and depth perception and a range of applications will be discussed in detail. Another related topic is user interfaces for medical applications. There is an increasing number of devices and information in the OR. On one side this has a lot of advantages for the surgeon, on the other side the surgeon has to handle many devices and has to process all the information. Furthermore interaction with devices is difficult as the surgeon has to be sterile and can not use mouse and keyboard. So there is an increasing interest in novel user interfaces using e.g. gestures.


Edit | Attach | Refresh | Diffs | More | Revision r1.21 - 26 Apr 2012 - 07:36 - TobiasBlum

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif