Erweiterte Realität II

Prof. Gudrun Klinker, Ph.D.

Content

Augmented Reality (AR) allows users to view computer information that is graphically embedded within the real three-dimensional world. Using a semi-transparent head-mounted display (HMD) attached to a wearable computer, a user can inspect and manipulat e objects while viewing information about these objects in the HMD. This information is typically displayed as virtual objects in the real world, thus augmenting the perception of the user. The wearable computer enables users to carry their work as they normally do, without imposing constraints on their mobility or their hand. AR applications span from medical minimally invasive surgery to manufacturing, from machine inspection and repair to games and tourist guides.

This class presents technical and mathematical foundations of Augmented Reality - as used in current international research and applications. In particular, the class will teach

• Geometric concepts (projective transformations, epipolar geometry) that are required for optically registering and tracking objects,
• Concepts for modeling user contexts in ubiquitous environments

The class will be conducted in English

Bereich

• Diplom-Studiengang: Haupstudium
• Bachelor/Master-Studiengang

• 2 SWS Vorlesung im Bereich Informatik I (Praktische Informatik)

Beginn

Dienstag, 20. April 2004, 09:00 Uhr in Raum 01.07.014

Wöchentliche Termine

• Zeit: Dienstags, 9:00-10:30 Uhr
• Ort: Raum 01.07.014

Teilnehmerkreis

• Studierende im Hauptstudium der Informatik
• Bachelorstudierende der Informatik

Voraussetzungen

• Grundstudium Informatik

Schein

• Mündliche Prüfung in der letzten Semesterwoche

Sprechstunde

• Anmeldung per Email an klinker@in.tum.de

Oral Exams

Wed, July 28	13:00	Nicolas Padoy
	13:30	Nicolas Padoy (Prakt.)
Thur, July 29	9:00
	9:30	Franziska Bayer
	10:00	Georg Kalus (Prakt.)
	10:30	Troels Frimor
	12:00
	12:30
Tue, Aug 17	9:00
	9:30	Christian Mayer
	10:00	Michael Trommler
	10:30	Jens Köchling
	11:00	Jens Köchling (Prakt.)
	11:30	Safak Ökmen
	12:00	Petr Ossipov
	12:30

Schedule

Date	Subject	links to slides
Apr. 20	Introduction	L1-intro.pdf
Apr. 27	Projective geometry	L2-ProjGeom.pdf
May 4	... no class ...	...
May 11	Camera calibration	L3-CamCalib.pdf
May 18	Sensor fusion (multiple cameras)	L4-GeometricSensorFusion.pdf
May 25	Sensor fusion (Kalman filtering)	L5-KalmanFilter.pdf
June 1	... no class (pentacost) ...	...
June 8	Ubiquitous tracking	L6-ubitrack-080604.pdf
June 15	Designing user interfaces: human factors	L7-UI-HumanFactors.pdf
June 22	Designing user interfaces: theories, principles and guidelines	L8-UI-Principles.pdf
June 29	User interface software tools	L9-UI-SW-tools.pdf
July 6	Direct manipulation, virtual environments	L10-UI-DirectManip.pdf
July 13	User interfaces for AR: Wearable, multimodal, tangible	L11-TUIs.pdf
July 20	Conclusions, discussion, demos

Literature (suggestions for further reading)

• Computer graphics, coordinate systems:
  • J.D. Foley, A. Van Dam, S.K. Feiner, and J.F. Hughes.
    Computer Graphics, Principles and Practice,
    2. Edition. Addison Wesley, 1989.
  • A. Zisserman and R. Hartley
    Multiple View Geometry in Computer Vision
    Cambridge University Press, 2000
• VRML:
  • Andrea L. Ames, David R. Nadeau and John L. Moreland.VRML 2.0 Source Book,
    2nd Edition, Wiley & Sons, 1996. ISBN 0-471-16507-7.
• OpenGL:
  • J. Neider et al.
    Open GL Programming Guide,
    Addison Wesley, 1993, ISBN 0-201-63274-8.
• Mixed Reality:
  • P. Milgram and H. Colquhoun Jr.
    "A Taxonomy of Real and Virtual World Display Integration",
    Proc. 1st International Symposium on Mixed Reality (ISMR),
    Yokohama, Japan, March 1999, in book Y. Ohta, H. Tamura (eds.),
    Mixed Reality - Merging Real and Virtual Worlds, Springer Verlag 1999, pp. 5-30.
• Information Presentation:
  • G. Klinker, O. Creighton, A.H. Dutoit, R. Kobylinski, C. Vilsmeier, B. Bruegge.
    "Augmented Maintenance of Powerplants: A Prototyping Case Study of a Mobile AR System".
    Proc. International Symposium on Augmented Reality (ISAR'01), New York, 2001.
• Displays
  • J. Rolland and H. Fuchs.
    "Optical versus Video See-Through Head-Mounted Displays",
    Fundamentals of Wearable Computers and Augmented Reality
    (eds. W. Barfield and T. Caudell), chapter 4.
    Lawrence Erlbaum Associates, 2001. ISBN 0-8058-2902-4.
• Multi-modal Tracking, Sensor Fusion:
  • J. Rolland, L.D. Davis and Y. Baillot.
    "A Survey of Trackng Technology for Virtual Environments",
    Fundamentals of Wearable Computers and Augmented Reality
    (eds. W. Barfield and T. Caudell), chapter 3.
    Lawrence Erlbaum Associates, 2001. ISBN 0-8058-2902-4
• Optical Tracking, Calibration (Computer Vision):
  • R. Jain, R. Kasturi, and B. Schunk.
    Machine Vision,
    McGraw Hill, 1995, ISBN 0-07-032018-7.
  • R. Y. Tsai.
    A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision.
    IBM Technical Report 1985.
• Software Engineering, Wearable Systems
  • M. Bauer, B. Bruegge, G. Klinker, A. Mac Williams, T. Reicher, S. Riss, C. Sandor, and M. Wagner.
    "Design of a Component-Based Augmented Reality Framework".
    Proc. International Symposium on Augmented Reality (ISAR'01), New York, 2001.
  • B. Bruegge and A. Dutoit.
    Software Engineering.