We propose a complete real-time model-based tracking system for piecewise-planar objects which combines template-based and feature-based approaches. The contributions are an extension to the ESM algorithm used for template-based tracking and the formulation of a feature-based tracking approach, which is specifically tailored for use in a real-time setting. In order to cope with highly dynamic scenarios, such as illumination changes, partial occlusions and fast object movement, the system adaptively switches between template-based tracking, feature-based tracking and a global initialization phase. The tracking system achieves real-time performance by applying a coarse-to-fine optimization approach and includes means to detect a loss of track.
If you want to see the tracking system in action have a look at this video.
![]() ![]() |
A. Ladikos, S. Benhimane, N. Navab
A Real-Time Tracking System Combining Template-Based and Feature-Based Approaches International Conference on Computer Vision Theory and Applications, Barcelona, Spain, March 2007. (bib) |
Students.ProjectForm | |
---|---|
Title: | Towards Robust Markerless Tracking: Combining Feature-based and Intensity-based Approaches |
Abstract: | There exist several approaches for markerless tracking, including feature-based and intensity-based ones. However not every approach works equally well for a given object. The goal of this work is to combine intensity-based and feature-based approaches in order to improve the robustness of the tracking. |
Student: | Alexander Ladikos |
Director: | Nassir Navab |
Supervisor: | Selim BenHimane |
Type: | Diploma Thesis |
Status: | finished |
Start: | 2006/05/15 |
Finish: | 2006/11/15 |