MaUncertainty3DCV

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Uncertainty Aware Methods for Camera Pose Estimation in Images and 3-Dimensional Data

Supervision: @TU Munich: Prof. Dr. Nassir Navab, Dr. Shadi Albarqouni. @Stanford: Prof. Dr. Leonidas Guibas, Dr. Tolga Birdal

Camera pose estimation is the term for determining the 6-DoF rotation and translation parameters of a camera. It is now a key technology in enabling multitudes of applications such as augmented reality, autonomous driving, human computer interaction and robot guidance. For decades, vision scholars have worked on finding the unique solution of this problem. Yet, this trend is witnessing a fundamental change. The recent school of thought has begun to admit that for our highly complex and ambiguous real environments, obtaining a single solution is not sufficient. This has led to a paradigm shift towards estimating rather a range of solutions in the form of full probability or at least explaining the uncertainty of camera pose estimates. Thanks to the advances in Artificial Intelligence, this important problem can now be tackled via machine learning algorithms that can discover rich and powerful representations for the data at hand. In collaboration, TU Munich and Stanford University plan to devise and implement generative methods that can explain uncertainty and ambiguity in pose predictions. In particular, our aim is to bridge the gap between 6DoF pose estimation either from 2D images/3D point sets and uncertainty quantification through multimodal variational deep methods.

Requirements:

  • Good knowledge of signal and image processing
  • Good background in Machine Learning, in particular, Deep Learning
  • Strong skills in Python (Numpy, Scikit-learn, and Tensorflow) programming

Benefits:

  • Workspace at CAMP and Stanford
  • Gain further experience in Computer Vision applications
  • Flexible time schedule

Funding:


ProjectForm
Title: Uncertainty Aware Methods for Camera Pose Estimation in Images and 3-Dimensional Data
Abstract: Camera pose estimation is the term for determining the 6-DoF rotation and translation parameters of a camera. It is now a key technology in enabling multitudes of applications such as augmented reality, autonomous driving, human computer interaction and robot guidance. For decades, vision scholars have worked on finding the unique solution of this problem. Yet, this trend is witnessing a fundamental change. The recent school of thought has begun to admit that for our highly complex and ambiguous real environments, obtaining a single solution is not sufficient. This has led to a paradigm shift towards estimating rather a range of solutions in the form of full probability or at least explaining the uncertainty of camera pose estimates. Thanks to the advances in Artificial Intelligence, this important problem can now be tackled via machine learning algorithms that can discover rich and powerful representations for the data at hand. In collaboration, TU Munich and Stanford University plan to devise and implement generative methods that can explain uncertainty and ambiguity in pose predictions. In particular, our aim is to bridge the gap between 6DoF pose estimation either from 2D images/3D point sets and uncertainty quantification through multimodal variational deep methods.
Student: Mai Bui, Haowen Deng
Director: Prof. Dr. Nassir Navab, Prof. Dr. Leonidas Guibas
Supervisor: Dr. Shadi Albarqouni, Dr. Tolga Birdal
Type: Project
Area: Machine Learning, Computer Vision
Status: running
Start: 01.01.2020
Finish:  
Thesis (optional):  
Picture:  


Edit | Attach | Refresh | Diffs | More | Revision r1.2 - 09 Dec 2019 - 01:45 - TolgaBirdal