ProjectKinectMagicMirror

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Augmented Reality Magic Mirror using the Kinect

Augmented Reality Magic Mirror using the Kinect

In medical collaboration with:

Prof. Dr. med. Jens Waschke , Klinikum Innenstadt, LMU, Munich, Germany
Dr. Simon Weidert, Klinikum Innenstadt, LMU,Munich, Germany

Scientific Director: Prof. Nassir Navab

Contact Person(s): Prof. Nassir Navab, Ph.D. Pascal Fallavollita and M.Sc. Ma Meng

Keywords: Medical Augmented Reality, 3D Information Presentation, 3D Interaction

Abstract

The Kinect allows tracking of users without additional markers. We develop a magic mirror that generated an overlay of a video image with volume visualization from a CT volume. Such a system could be used for education of anatomy.

Detailed Project Description

The Microsoft Kinect provides a color and a depth image. Using OpenNI and PrimeSense NITE we can get the skeleton of a person standing in front of the Kinect in real-time.

We register a CT dataset to this skeleton and do an Augmented Reality overlay of the CT and the person. Using context and focus visualization we only show the CT through a virtual window, while still showing the person.

The Kinect is positioned next to a big screen. When standing in front of the system, the system acts like a magic mirror that allows seeing inside yourself. Such a system can be used for educational purposes to teach anatomy.

The system is currently a prototype. It does not show the CT of the person in front of the monitor, but a CT of another person. We use the Visible Korean Human dataset that has been provided to us by Prof. Min Suk Chung.

If you are interested in our research here you can find more information about our research on Medical Augmented Reality

Videos

Team

Contact Person(s)

Ma Meng
M.Sc. Ma Meng
Nassir Navab
Prof. Dr. Nassir Navab
Pascal Fallavollita
Dr. Pascal Fallavollita

Working Group

Ma Meng
M.Sc. Ma Meng
Nassir Navab
Prof. Dr. Nassir Navab
Patrick Wucherer
Dipl.-Inf. Univ. Patrick Wucherer
Philipp Stefan
Philipp Stefan

Alumni

Christoph Bichlmeier
Dr. Christoph Bichlmeier
Tobias Blum
Dr. Tobias Blum

Location



internal project page

Please contact Prof. Nassir Navab, Ph.D. Pascal Fallavollita and M.Sc. Ma Meng for available student projects within this research project.



Edit | Attach | Refresh | Diffs | More | Revision r1.4 - 30 Jan 2012 - 12:16 - TobiasBlum

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif