Dr. Chun-Hao Paul Huang (黃俊豪)

Contact email paulch DOT huang AT tum DOT de personal webpage http://paulchhuang.wixsite.com/chhuang office tel/fax +49 89 289 19441/17059 room 03.13.039 address Institut für Informatik I-16, Technische Universität München, Boltzmannstr. 3, 85748 Garching, Germany my CV (01.Jun.18)

Textured model of me reconstructed by Kinovis

About Me

I am a fourth-year Ph.D. student in TUM, under the guidance of PD Dr. Slobodan Ilic and Prof. Nassir Navab. Prior to TUM, I spent six wonderful years at NCKU where I had the chance to work with Jar-Ferr Kevin Yang and completed my BSc in Electrical Engineering and MSc in Computer Engineering. In the past few years, I've also had the pleasure to work with: Dr. Yu-Chiang Frank Wang in team MML, Academia Sinica; Dr. Edmond Boyer in team Morpheo, INRIA; Dr. Federico Tombari in CAMP; MIX team in Microsoft Research Redmond; and Capture and Effects team in Disney Research Zürich.

I'll be available in the job market from Spring 2017. If you have questions or anything to discuss with me, please feel free to drop me an email.

News

• [15.08.17] Our paper "Tracking-by-Detection of 3D Human Shapes: from Surfaces to Volumes" got accepted for TPAMI. Check out the pre-print version.
• [10.05.17] Our CVPR`16 results (associations from random forests) can be downloaded here.
• [19.12.16] Thesis defended!
• [04.07.16-07.10.16] Research internship at Disney Research Zurich.
• [02.03.16] Our paper "Volumetric 3D Tracking By Detection" got accepted as a oral spotlight presentation at CVPR 2016.
• [12.08.15] Our paper "Repeatable Local Coordinate Frames for 3D Human Motion Tracking: from Rigid to Non-Rigid" got accepted as a poster presentation at 3DV 2015.
• [22.06.15-11.09.15] Research internship at Microsoft Research Redmond.
• [27.05.15] Our paper "A Bayesian Approach to Multi-view 4D Modeling" got accepted for International Journal of Computer Vision (IJCV).
• [02.03.15] Our paper "Toward User-specific Tracking by Detection of Human Shapes in Multi-Cameras" got accepted as a poster presentation at CVPR 2015.
• [01.02.15] I'm visiting Morpheo team in INRIA (Grenoble, France) from 1st of February til 13th of February.
• [30.06.14] CVPR`14 sequences released! Besides images, silhouettes and reconstructed visual hulls, we also provide reference surfaces, rigged skeletons, and annotated joint locations (in 5 cameras). Check the following links: WalkChair, and HammerTable & SideSit.
• [01.03.14] Our paper "Human Shape and Pose Tracking Using Keyframes" got accepted as a poster presentation at CVPR 2014
• [18.02.14] Previous work at Academia Sinica, "Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace" got accepted for TIP (demo code).
• [30.06.13] Our 3DV oral paper "Robust Human Body Shape and Pose Tracking" was awarded as best paper runner up ! (link)
• [16.05.13] Our paper "Robust Human Body Shape and Pose Tracking" got accepted as a oral presentation at 3DV (former 3DimPVT) 2013 .

Research Projects

Spatio Temporal Modeling of Dynamic Scenes A great part of Computer Vision research has been dedicated to shape recovery, tracking and detection of 3D objects in images and videos. While excellent results have been achieved in these areas, the majority of the methods still assume static scenes and rigid objects, and rarely explore temporal information. However, the world surrounding us is highly dynamic, and in many situations objects deform over time. This temporal information provides a richer and denser source of information and have not yet been extensively exploited. Our objective within this project is to explore spatio-temporal information in order to recover 3D shapes and the motion of the deformable objects. Therefore, we refer to this area as spatio-temporal or four dimensional modeling (4D modeling). With the increased popularity of 3D content in film industry, TV, Internet and games, tools and methods that exploit spatio-temporal information and allow fast and automated 3D content production are going to be indispensable.

Student Projects for Hiwi and Dipl./B.Sc./M.Sc. Thesis

	User-specific Human Shape Detection in Full 3D data (surface-based) Inspired by the recent work that applies random forests to estimate human poses with depth data (either via body part classification or dense correspondences), in this project we investigate the possibility to infer the dense correspondences between a surface model and a complete 3D visual hull obtained in multiple camera environments. With frame-wise data-model associations, our method is able to detect human shapes in a clutter scene, which we term tracking-by-detection of 3D human shapes.			Markov Random Field for Regularizing Matches between Meshes The inferred data-model associations from the forests often look noisy because it does not respect the intrinsic structure, i.e. triangles/edge connectivity. In this project, we mitigate this by proposing a new way to aggregate leaf-node predictions from forests. As the correspondences are highly interdependent among the local neighborhood, we apply random fields (MRF/CRF) to regularize them, yield the optimal configuration w.r.t. the whole shape. The aggregation is therefore mesh-based rather than vertex-based.
	Volumetric Tracking by Detection Following the above tracking-by-detection concept, in this project we investigate different parameterizations of 3D shapes. We choose centroidal Voronoi tessellation (CVT) as the shape representation and realize discriminative correspondences in a volumetric manner. We further propose a unified volumetric tracking-by-detection pipeline, where the shape representation, deformation model, feature description, and primitive association are all built on a single consistent representation, CVT.			Human Shape and Pose Tracking without Background Subtraction In this project, we investigate the possibility to recover human motions directly with images, without doing background subtraction. The 3D surfaces are expected to be textured, or at least contain per-vertex color information. Thus, the problem amounts to maximizing the similarity between the projected texture of surfaces and the image observations.

Publications at CAMP 2017 C.-H. Huang, B. Allain, E. Boyer, J.-S. Franco, F. Tombari, N. Navab, S. Ilic Tracking-by-Detection of 3D Human Shapes: from Surfaces to Volumes IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (bib) 2016 C.-H. Huang, B. Allain, J.-S. Franco, N. Navab, S. Ilic, E. Boyer Volumetric 3D Tracking by Detection IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, June 2016 (spotlight presentation) (supp., poster, spotlight oral video) The first two authors contribute equally to this paper. (bib) Xiang Wang, S. Habert, Ma Meng, C.-H. Huang, P. Fallavollita, N. Navab Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope International Journal of Computer Assisted Radiology and Surgery (bib) C.-H. Huang, C. Cagniart, E. Boyer, S. Ilic A Bayesian Approach to Multi-view 4D Modeling International Journal of Computer Vision (IJCV), Springer Verlag. The final publication is available at www.springerlink.com. The first two authors contribute equally to this paper. (bib) 2015 C.-H. Huang, F. Tombari, N. Navab Repeatable Local Coordinate Frames for 3D Human Motion Tracking: from Rigid to Non-Rigid International Conference on 3D Vision (3DV), Lyon, France, Oct. 20, 2015 (bib) Xiang Wang, S. Habert, Ma Meng, C.-H. Huang, P. Fallavollita, N. Navab RGB-D/C-arm Calibration and Application in Medical Augmented Reality International Symposium on Mixed and Augmented Reality (ISMAR), 2015 (bib) C.-H. Huang, E. Boyer, B. do Canto Angonese, N. Navab, S. Ilic Toward User-specific Tracking by Detection of Human Shapes in Multi-Cameras IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, June 2015 (supp., poster) (bib) 2014 C.-H. Huang, E. Boyer, N. Navab, S. Ilic Human Shape and Pose Tracking Using Keyframes IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, USA, June 24, 2014 (supp., poster) (bib) 2013 C.-H. Huang, E. Boyer, S. Ilic Robust Human Body Shape and Pose Tracking International Conference on 3D Vision (3DV), Seattle, USA, June 29, 2013 (oral, best paper runner up) (slides, poster) (bib) Publications of early projects Y.-R. Yeh, C.-H. Huang, Y.-C. F. Wang, Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace, IEEE Transactions on Image Processing (TIP), vol. 23, no. 5, pp. 2009-2018, May. 2014 (pdf) C.-H. Huang, Y.-R. Yeh, Y.-C. F. Wang, Recognizing Unseen Actions across Cameras by Exploring the Correlated Subspace, European Conference on Computer Vision (ECCV), The 4th International VECTaR? Workshop, Firenze, Italy, October 12, 2012 (pdf, slides) H.-M. Wang, C.-H. Huang, J.-F. Yang, Block-Based Depth Maps Interpolation for Efficient Multiview Content Generation, IEEE Transactions On Circuits And Systems for Video Technology (TCSVT), vol. 21, no. 12, pp. 1847-1858, Dec. 2011 H.-M. Wang, C.-H. Huang, J.-F. Yang, Depth Maps Interpolation from Existing Pairs of Keyframes and Depth Maps for 3D Video Generation, IEEE International Symposium on Circuits and Systems (ISCAS), Paris, France, May 30 - June 2, 2010

Code, dataset and results 3DV`13 results. Contact me for the accessing password. TIP`14 demo code. CVPR`14 sequences: robust tracking in the presence of static outliers/occlusions. CVPR`15 and CVPR`16 results: surface-based and fully volumetric tracking-by-detection of 3D human shapes Awards 3DV 2013: Best Paper Runner Up for our paper "Robust Human Body Shape and Pose Tracking." Teaching assistance Hauptseminar: Machine Learning in Imaging and Visualization, WS 2014/15 Lecture: Tracking and Detection in Computer Vision, WS 2014/15 Lecture: Tracking and Detection in Computer Vision, WS 2013/14 Lecture: Tracking and Detection in Computer Vision, WS 2012/13