DaYordanov

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

Enabling Personalized Augmented Reality Display Technology in Cars

Subject

With recent advances of Head-up Display (HUD) technology in cars, Augmented Reality becomes interesting in supporting the driving task. At our lab, we have a driving simulator and are currently setting up a HUD with a tilted image plane. The image plane of a normal HUD appears to be vertical to the driver, while a conformal HUD has an image plane that lies on the street. So it is capable to provide depth based information.

HUD_Kontaktanalog.png
Sketch of the planned contactanalog HUD (Courtesy of BMW, adapted)

Fresnel Lense
Picture distored by a fresnel lense

This thesis focus resides in mechanically adjusting a linear motor to tilt the focal plane and therefore adjust it to the flat road. When this works properly, rendered virtual 3D objects must be rendered onto a textured object in order to compensate distortion of the cars windshield.

Issues

Calibrate Aligned Rendering

Generate Projectionmatrix from eight viewpoints. That cube specifies the volume, head moves inside.

Interpolate Dynamic Viewpoint Dependent Projection Matrix

Image Warping

Warp Rendered Image Distored by Fresnel Lense

Fresnel lense distortion in general is static, but dependent to viewpoint.

Warp Rendered Image Distored by Windshield

Every windshield generates another distortion of the image.

Incorporate Slope Sensor

-- MarcusToennis - 25 Jan 2007

ProjectForm
Title: Enabling Personalized Augmented Reality Display Technology in Cars
Abstract: This thesis' focus resides on developing technologies that enable incorporation of AR techniques into cars to enable driver assistance systems. For this purpose the rendered virtual content is presented on a conformal Head-Up Display (HUD) that uses the car's windshield. The construction of the HUD introduces two major sources of distortion on the image that have to be overcome: lens distortion caused by the fresnel lens, which is used to stretch the distance between the driver's eyes and the focal plane of the HUD, and distortion due to the curved shape of the windshield. Every windshield is unique in its shape so first a calibration procedure that can extract the distortion parameters of any given windshield should be developed, and then distortion correction can be performed with the help of a piecewise projective warping function. A calibration procedure for fresnel lenses should also be implemented, and with its help the image can be undistorted by using a radial distortion warping function. Since the image distortion presented by a lens depends on the distance and position of the viewer with respect to the center of the lens, the driver's head position has to be taken also into account when developing the correction function. For tracking the driver's head we intend to use a 6DOF-Tracker, for example UbiTrack?. The tracked driver's pose is also needed for continuously adapting the projection and viewing matrix of the rendering process, so that virtual objects are always aligned in the physical world.
Student: Michail Yordanov
Director: Gudrun Klinker
Supervisor: Marcus Tönnis
Type: DA/MA/BA
Area:  
Status: finished
Start: 2007/11/15
Finish: 2008/07/15


Edit | Attach | Refresh | Diffs | More | Revision r1.17 - 11 Aug 2008 - 13:14 - GudrunKlinker