ProjectKinectMagicMirror_form

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality


Augmented Reality Magic Mirror using the Kinect

Contact person(s) : Prof. Nassir Navab, Ph.D. Pascal Fallavollita and M.Sc. Ma Meng


+ Abstract
+ Videos


Keywords: Medical Augmented Reality, 3D Information Presentation, 3D Interaction


Abstract

The Microsoft Kinect provides a color and a depth image. Using OpenNI?? and PrimeSense?? NITE we can get the skeleton of a person standing in front of the Kinect in real-time. We register a CT dataset to this skeleton and do an Augmented Reality overlay of the CT and the person. Using context and focus visualization we only show the CT through a virtual window, while still showing the person. The Kinect is positioned next to a big screen. When standing in front of the system, the system acts like a magic mirror that allows seeing inside yourself. Such a system can be used for educational purposes to teach anatomy. The system is currently a prototype. It does not show the CT of the person in front of the monitor, but a CT of another person. We use the Visible Korean Human dataset that has been provided to us by Prof. Min Suk Chung.


Videos

‘Mirracle’: The Magic Mirror technology for anatomy learning




Edit | Attach | Refresh | Diffs | More | Revision r1.10 - 05 Jun 2014 - 14:18 - SeverineHabert

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif