Contact person(s) : Prof. Nassir Navab, Ph.D. Pascal Fallavollita and M.Sc. Ma Meng

Augmented Reality Magic Mirror using the Kinect

Keywords: Medical Augmented Reality, 3D Information Presentation, 3D Interaction

Abstract

The Microsoft Kinect provides a color and a depth image. Using OpenNI^? and PrimeSense^? NITE we can get the skeleton of a person standing in front of the Kinect in real-time. We register a CT dataset to this skeleton and do an Augmented Reality overlay of the CT and the person. Using context and focus visualization we only show the CT through a virtual window, while still showing the person. The Kinect is positioned next to a big screen. When standing in front of the system, the system acts like a magic mirror that allows seeing inside yourself. Such a system can be used for educational purposes to teach anatomy. The system is currently a prototype. It does not show the CT of the person in front of the monitor, but a CT of another person. We use the Visible Korean Human dataset that has been provided to us by Prof. Min Suk Chung.

Videos

‘Mirracle’: The Magic Mirror technology for anatomy learning

Location

Ludwig-Maximilians-Universität München Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS Nussbaumstr. 20 80336 München Room: C2.06 Tel.: +49 89 5160-3615 Tel.: +49 89 5160-3635 Fax: +49 89 5160-3630

Visit our lab at Klinikum Innenstadt.



internal project page

Please contact for available student projects within this research project.