ProjectKinectMagicMirror

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Augmented Reality Magic Mirror using the Kinect

Augmented Reality Magic Mirror using the Kinect

Contact Person(s): Ma Meng

Keywords: Medical Augmented Reality, 3D Information Presentation, 3D Interaction

Abstract

The Kinect allows tracking of users without additional markers. We develop a magic mirror that generated an overlay of a video image with volume visualization from a CT volume. Such a system could be used for education of anatomy.

Detailed Project Description

The Microsoft Kinect provides a color and a depth image. Using OpenNI and PrimeSense NITE we can get the skeleton of a person standing in front of the Kinect in real-time.

We register a CT dataset to this skeleton and do an Augmented Reality overlay of the CT and the person. Using context and focus visualization we only show the CT through a virtual window, while still showing the person.

The Kinect is positioned next to a big screen. When standing in front of the system, the system acts like a magic mirror that allows seeing inside yourself. Such a system can be used for educational purposes to teach anatomy.

The system is currently a prototype. It does not show the CT of the person in front of the monitor, but a CT of another person. We use the Visible Korean Human dataset that has been provided to us by Prof. Min Suk Chung.

If you are interested in our research here you can find more information about our research on Medical Augmented Reality

Team

Contact Person(s)

Ma Meng
M.Sc. Ma Meng

Working Group

Ma Meng
M.Sc. Ma Meng
Nassir Navab
Prof. Dr. Nassir Navab
Patrick Wucherer
Dipl.-Inf. Univ. Patrick Wucherer
Philipp Stefan
Philipp Stefan

Alumni

Christoph Bichlmeier
Dr. Christoph Bichlmeier
Tobias Blum
Dipl.-Inf. Univ. Tobias Blum

Location



Ludwig-Maximilians-Universität München
Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS
Nussbaumstr. 20
80336 München

Room: C2.06
Tel.: +49 89 5160-3615
Tel.: +49 89 5160-3635
Fax: +49 89 5160-3630
Visit our lab at Klinikum Innenstadt.



Klinikum rechts der Isar
der Technischen Universitüt München
Ismaninger Str. 22
81675 München

IFL Lab - Room: 01.3a-c
Tel.: +49 89 4140-6457
Fax: +49 89 4140-6458
Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Ma Meng for available student projects within this research project.



Edit | Attach | Refresh | Diffs | More | Revision r1.4 - 30 Jan 2012 - 12:16 - TobiasBlum

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif