Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Towards Robust Markerless Tracking: Combining Feature-based and Intensity-based Approaches

We propose a complete real-time model-based tracking system for piecewise-planar objects which combines template-based and feature-based approaches. The contributions are an extension to the ESM algorithm used for template-based tracking and the formulation of a feature-based tracking approach, which is specifically tailored for use in a real-time setting. In order to cope with highly dynamic scenarios, such as illumination changes, partial occlusions and fast object movement, the system adaptively switches between template-based tracking, feature-based tracking and a global initialization phase. The tracking system achieves real-time performance by applying a coarse-to-fine optimization approach and includes means to detect a loss of track.

If you want to see the tracking system in action have a look at this video.


Related Publications

A. Ladikos, S. Benhimane, N. Navab
A Real-Time Tracking System Combining Template-Based and Feature-Based Approaches
International Conference on Computer Vision Theory and Applications, Barcelona, Spain, March 2007. (bib)

Title: Towards Robust Markerless Tracking: Combining Feature-based and Intensity-based Approaches
Abstract: There exist several approaches for markerless tracking, including feature-based and intensity-based ones. However not every approach works equally well for a given object. The goal of this work is to combine intensity-based and feature-based approaches in order to improve the robustness of the tracking.
Student: Alexander Ladikos
Director: Nassir Navab
Supervisor: Selim BenHimane
Type: Diploma Thesis
Status: finished
Start: 2006/05/15
Finish: 2006/11/15

Edit | Attach | Refresh | Diffs | More | Revision r1.9 - 05 Feb 2007 - 10:59 - AlexanderLadikos