Gesture Recognition in a VR environment - Kinect

This Work could be done in a BA, MA and Guided research thesis, the requirements are decided accordingly.

Interaction in an immersive virtual environment (IVE) such as a CAVE is divided into three main tasks: Travel techniques, selection/manipulation techniques and system control techniques. Users are active participants in the 3D computer generated virtual world, and are able to explore, select and manipulate the world and embedded data. The Purpose of the project is to investigate the usage of Depth camera xbox “Kinect” to implement some gesture recognition in a Virtual Reality environment. The gestures are analyzed to perform 3D Menu selection task and Parameter adjustments in a dynamic simulation in VR. For this purpose Particle tracer software is used. Two parameters (Reynolds values , Viscosity) are to be adjusted through gesture recognition.

Tasks:
1- Perform some research about Kinect gesture recognition capabilities
2- Implementation of a simple visual menu to be able to select the parameter adjustments task. E.g. : Menu -> Parameter Adjustment
3- Design and implementation of the different visual items with the respective gestures for parameter adjustment tasks: Horizontal/Vertical sliders Vs Probes and hand swipe for circular swipe.
4- Making possible to fine vs coarse changing the parameters: based on the velocity of the gesture or based on if it is a one hand gestures or two handed gesture.

This is work is going to be a part of an ongoing project; Android phone has been already used for travel task using the built in sensors and the multi-touch capability of the phone. Check the following BA thesis: Phone Based Motion Control projet webpage

Kinect Depth camera

Tasks:

• Literature research
• Understanding of 3D User Interfaces: Selection interaction
• Gesture Recognition

Requirements

• Communication skills
• Knowledge in OpenGL^?
• Good knowledge of development in Java, Understanding C# code.
• Inetrest in 3DUI and gesture recognition and mapping.
• Creativity

Contact

Please feel free to stop by, to get more insights about the project.

• Amal Benzina : benzina@in.tum.de