ProjectSceneUnderstanding

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Scene Understanding From a Moving Camera

Scene Understanding From a Moving Camera

Scientific Director: Slobodan Ilic

Contact Person(s): Vladimir Haltakov

In industrial collaboration with:
BMW Group

Keywords: Segmentation, Reconstruction, Computer Vision

Abstract

Modern vehicles are equipped with multiple cameras which are already used in various practical applications. Advanced driver assistance systems (ADAS) are of particular interest because of the safety and comfort features they offer to the driver. Camera based scene understanding is an important scientific problem that has to be addressed in order to provide the information needed for camera based driver assistance systems. While frontal cameras are widely used, there are applications where cameras observing lateral space can deliver better results. Fish eye cameras mounted in the side mirrors are particularly interesting, because they can observe a big area on the side of the vehicle and can be used for several applications for which the traditional front facing cameras are not suitable.

We present a general method for scene understanding using 3D reconstruction of the environment around the vehicle. It is based on pixel-wise image labeling using a conditional random field (CRF). Our method is able to create a simple 3D model of the scene and also to provide semantic labels of the different objects and areas in the image, like for example cars, sidewalks, and buildings.

We demonstrate how our method can be used for two applications that are of high importance for various driver assistance systems - car detection and free space estimation. We show that our system is able to perform in real time for speeds of up to 63 km/h.

Pictures

Figure 1: Undistorted camera image
Figure 2: Segmented camera image
Figure 3: Reconstructed 3D model

Videos

Camera video

Segmented camera images

3D reconstruction

Publications

2012
V. Haltakov , H. Belzner, S. Ilic
Scene Understanding From a Moving Camera for Object Detection and Free Space Estimation
Intelligent Vehicles Symposium, Alcalá de Henares 4.-6. June 2012 (bib)

Team

Contact Person(s)

Vladimir Haltakov
M.Sc. Vladimir Haltakov

Location



internal project page

Please contact Vladimir Haltakov for available student projects within this research project.



Edit | Attach | Refresh | Diffs | More | Revision r1.2 - 12 Jul 2013 - 11:19 - VladimirHaltakov

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif