DaHumanShapeBottomUp

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Dipl. / Master Thesis: 3D Human Pose/Shape Tracking: when bottom-up meets top-down

Student: -
Advisor: Prof. Dr. Nassir Navab
Supervised by: Chun-Hao Paul Huang, Dr. Slobodan Ilic
Due date:

Overview

Human pose estimation can in general be categorized in two classes: top-down vs. bottom-up. The former estimates poses by deforming a reference 3D human surface frame by frame, and avoids unreasonable poses by enforcing constraints on surface deformations. The latter starts with body part detections in 2D images, back-projects the detected body parts from each view, and attempts to assemble the skeletons in 3D space. The following two videos provide one typical example for each category:

        
top-down approach by surface tracking (Huang et al. 3DV 2013)          bottom-up approach by pictorial structure (Belagiannis CVPR 2014)


Although top-down methods provide visually and temporally smoother results, bottom-up approaches hold the advantage of not assuming background subtraction, which is suitable to more generalized applications. In this project, we investigate the possibility to find the middle ground, in order to retain the merits from both. Specifically, one first recovers rough 3D skeletal poses with state-of-the-art bottom-up approach as initializations, and deform pre-defined human surfaces to fit to those poses. The generic human surface has to be adapted according to the size/scale of the skeleton. Skeleton-based animation such as linear-blend skinning, dual-quaternion-blend skinning is also worthwhile a look.

Requirements

  • The student can use whatever language he/she finds comfortable for fast prototyping, but the final solution is expected to be delivered in C++.
  • Knowledge in machine learning, and mesh processing is also helpful.

Literature & Resource

Bottom-up human pose estimation: Human shape adaptation/estimation: Skinning method: Top-down human pose/shape tracking:

Contact


Students.ProjectForm
Title: Multi-View Human Poses/Shape Tracking without Background Subtraction: a bottom-up approach
Abstract: In this project, we investigate the possibility to find the middle ground between top-down and bottom-up strategies, in order to retain the merits from both. Specifically, one first recovers rough 3D skeletal poses with state-of-the-art bottom-up approach as initializations, and deform pre-defined human surfaces to fit to those poses. The generic human surface has to be adapted according to the size/scale of the skeleton. Skeleton-based animation such as linear-blend skinning, dual-quaternion-blend skinning is also worthwhile a look.
Student:  
Director: Prof. Dr. Nassir Navab
Supervisor: Chun-Hao Paul Huang, Dr. Slobodan Ilic
Type: DA/MA/BA
Area: Computer Vision
Status: open
Start:  
Finish:  
Thesis (optional):  
Picture:  


Edit | Attach | Refresh | Diffs | More | Revision r1.5 - 29 Apr 2015 - 11:25 - ChunHaoHuang