Anwendungen der Augmented Reality
by
Katharina Pentenrieder and
Prof. Gudrun Klinker, Phd.
2 SWS,
4 ECTS
Abstract
Augmented Reality (AR) is a new technology which superimposes virtual information onto the real environment. The information is displayed in 3D and seamlessly integrated in the user's view of the scene.
This proseminar shall provide students with an overview on "classical" approaches and application of Augmented Reality. In each session papers which are representative for different aspects of AR are discussed. Each participant has to prepare such a talk (~45 min), present it and discuss it with the group.
Erweiterte Realität (Augmented Reality, AR) ist eine neue Technologie, die die reale Umgebung mit virtuellen Informationen anreichert. Die Informationen werden hierbei 3-dimensional und lagegerecht in das Sichtfeld des Benutzers eingeblendet.
In diesem Proseminar sollen Studierende einen Überblick über "klassische" Ansätze und Anwendungen von AR gewinnen. Hierzu wird bei jedem Veranstaltungstermin ein repräsentatives Paper zu verschiedenen Aspekten der AR besprochen. Die Aufgabe jedes Teilnehmers besteht dabei darin, einen solchen Vortrag (ca. 45 min) zu halten und mit der Gruppe zu diskutieren.
Organization
Registration
- To register, send an email to --- registration is closed!
- You can withdraw from your registration until October 12, 2007.
Requirements for a Schein
- Give a well prepared talk (~45 min) and handle follow up discussion
- Write a handout of 1-2 pages
- Be present at all talks (absence only allowed with doctoral certificate)
- Language for presentation, slides and handout can be either German or English
Timeline
- 4-6 weeks before presentation: Outline
- 2 weeks before presentation: Handout (here is a template)
- 1 week before presentation: Presentation Slides (here is a template)
- 1 week before presentation: Introduce your topic to the group in a 3 min presentation
Schedule
- The seminar will take place in 3 blocks plus an introducing session on 24/10.
- Room for all sessions is 03.13.010
| Time | Topic | Speaker | Video (restricted) |
| Wed 24.10. 15:00h | Introduction to the Seminar and to AR itself | KatharinaPentenrieder | |
| Wed 31.10. 15:30h | SEMINAR BLOCK I | | |
| | Displays and projectors | Andreas Gast | v1.wmv |
| | AR for training | Manuel Wolf | v2.wmv |
| | ... |
| Wed 07.11. 15:30h | SEMINAR BLOCK II | | |
| | Handheld AR | Daniel Adugna | v3.wmv |
| | AR for medical applications | Benedikt Schultis | v4.wmv |
| | AR for service and maintenance | Manuel Scharf | v5.wmv |
| Wed 21.11. 15:30h | SEMINAR BLOCK III | | |
| | AR in entertainment | Eleonor Cervantes | v6.wmv |
| | AR for production and planning | Christian Wiesner | v7.wmv |
| | Tracking | Alexander Szöke | v8.wmv |
Topics
Introduction to AR
Displays and projectors - visualization techniques
- first Head-Mounted Display by Ivan Sutherland (1968)
- J. Rolland and O. Cakmakci The past, present, and future of head-mounted display designs. Proc. SPIE, 5638:368–377, 2004.
- O. Cakmakci and J. Rolland,
Head-worn displays: A review.
IEEE Journal of Display Technologies, 2(3):199–216, 2006.
- Viirre, E., Pryor, H., Nagata, S., Furness, T. A. (1998),
The Virtual Retinal Display: A New Technology for Virtual Reality and Augmented Vision in Medicine
- Aktuell verfügbare HMDs
- O. Bimber, R. Raskar; Spatial Augmented Reality: Merging Real and Virtual Worlds; A. K. Peters, Ltd., Natick, MA, USA, 2005, Kapitel 8
Tracking and calibration - how to get those objects in the right place
- Rolland, J.P., L. Davis, and Y. Baillot, A Survey of Tracking Technology for Virtual Environments, in Augmented Reality and Wearable Computers, Ch. 3, Ed. Barfield and Caudell, Mahwah, NJ., 2001.
- Gary Bishop, Greg Welch, and B. Danette Allen, Tracking: Beyond 15 Minutes of Thought, SIGGRAPH 2001 Course Notes
- Greg Welch, Eric Foxlin, Motion Tracking: No Silver Bullet, but a Respectable Arsenal IEEE Computer Graphics and Applications, 22 (6), Nov/Dec 2002
Handheld AR
- M. Moehring, C. Lessig, and O. Bimber
Video See-Through AR on Consumer Cell Phones
In proceedings of International Symposium on Augmented and Mixed Reality (ISMAR'04), 2004
- M. Moehring, and C. Lessig, and O. Bimber
Optical Tracking and Video See-Through AR on Consumer Cell Phones
In proceedings of Workshop on Virtual and Augmented Reality of the GI-Fachgruppe AR/VR, 2004
- Siemens AG,
Virtual Mosquito Hunt
- Ojom GmbH,
Augmented Reality Games
- Kiriakos N. Kutulakos and James R. Vallino
Calibration-Free Augmented Reality
IEEE Transactions on Visualization and Computer Graphics, vol. 4, no. 1, pp. 1-20, 1998
- Kiriakos N. Kutulakos and James R. Vallino
Affine Object Representations for Calibration-Free Augmented Reality
Proceedings of IEEE Virtual Reality Annual International Symposium (VRAIS), pp. 25-36, 1996
AR for design and construction
- ARVIKA
Friedrich, Wolfgang (Hrsg.)
ARVIKA - Augmented Reality in Entwicklung, Produktion und Service
- D. Reiners, D. Stricker, G. Klinker, and S. Mueller,
Augmented Reality for Construction Tasks: Doorlock Assembly
- A. Webster, S. Feiner, B. MacIntyre?, W. Massie, T. Krueger,
Augmented Reality in Architectural Construction, Inspection and Renovation
- G. Klinker, A. Dutoit, M. Bauer,
Fata Morgana - A Presentation System for Product Design
- M. Fiorentino, R. de Micis, G. Monno, A. Stork,
Spacedesign: A Mixed Reality Workspace for Asthetic Industrial Design
IEEE and ACM International Symposium on Mixed and Augmented Reality 2002
- P. Santos, A. Stork, T. Gierlinger, A. Pagani
IMPROVE: An innovative application for collaborative mobile mixed reality design review
Proceedings of Virtual Concepts 2006
AR for production and planning
- ARVIKA
Friedrich, Wolfgang (Hrsg.)
ARVIKA - Augmented Reality in Entwicklung, Produktion und Service
- F. Echtler, F. Sturm, K. Kindermann, G. Klinker, J. Stilla, J. Trilk, H. Najafi,
The Intelligent Welding Gun: Augmented Reality for Experimental Vehicle Construction
- F. Doil, W. Schreiber, T. Alt, C. Patron,
Augmented reality for manufacturing planning
ACM Proceedings of the Eurographics Workshop on Virtual Environments 2003
- T. Alt
Augmented Reality in der Produktion
AR for product presentation and sales
AR for service and maintenance
- ARVIKA und ARTESAS
Friedrich, Wolfgang (Hrsg.)
ARVIKA - Augmented Reality in Entwicklung, Produktion und Service
- S. Feiner, B. Macintyre, D. Seligmann,
Knowledge-based Augmented Reality
- A. Janin, D. Mizell, T. Caudell,
Calibration of head-mounted displays for augmented reality
- J. Platonov, H. Heibel, P. Meier, B. Grollmann
A mobile markerless AR system for maintenance and repair
AR for training
- X. Zhong, P. Boulanger, N. Georganas,
Collaborative Augmented Reality: A Prototype for Industrial Training
- B. Schwald, B. de Laval,
An Augmented Reality System for Training and Assistance to Maintenance in the Industrial Context
- P. Boulanger,
Application of Augmented Reality to Industrial Tele-Training
- R. Bischoff, A. Kazi,
Perspectives on augmented reality based human-robot interaction with industrial robots
- C. Hughes, C. Stapleton, D. Hughes, E. Smith,
Mixed Reality in Education, Entertainment and Training
- H. Kaufmann,
Collaborative Augmented Reality in Education
- M. Billighurst,
Augmented Reality in Education
AR for medical applications
- M. Feuerstein, S.M. Wildhirt, R. Bauernschmitt, N. Navab,
Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery
Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2005), Palm Springs, USA, October 2005
- R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange
Improved Preoperative Planning in Robotic Heart Surgery
IEEE Proceedings of Computers in Cardiology (CinC? 2004), pp. 773 - 776, Chicago, USA, September 2004
- J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker
Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery
Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004
- G. Stetten, D. Shelton, W. Chang, V. Chib, R. Tamburo, D. Hildebrand, L. Lobes, J. Sumkin,
Towards a clinically useful Sonic Flashlight,
IEEE International Symposium on Biomedical Imaging 2002
- G. Stetten, V. Chib,
Overlaying Ultrasound Images on Direct Vision,
Journal of Ultrasound in Medicine, vol. 20, no. 3, pp. 235-240, 2001
- G. Stetten, V. Chib, R. Tamburo,
Tomographic Reflection to Merge Ultrasound Images with Direct Vision,
IEEE Proceedings of the Applied Imagery Pattern Recognition (AIPR) annual workshop, 2000, pp. 200-205.
- Publikationen auf http://campar.in.tum.de/Chair/ProjectCamC
AR for military applications
AR in entertainment
- O. Grau, A 3D production pipeline for special effects in TV and film, Proc. of Mirage 2005 conference, Computer Vision/Computer Graphics Collaboration Techniques and Applications. INRIA Rocquencourt, France, March 2005.
- O. Grau, 3D sequence generation from multiple cameras, Proc. of IEEE, International workshop on multimedia signal processing 2004, (Siena, Italy), September 2004.
- O. Grau, T. Pullen, G.A. Thomas, A combined studio production system for 3D capturing of live action and immersive actor feedback, IEEE Trans. on Circuits and Systems for Video Technology, March 2004.
- O. Grau, A studio production system for dynamic 3D content, Proceedings of Visual Communications and Image Processing 2003, Proceedings of SPIE Vol. 5150 (2003).
- G.A. Thomas, M. Koppetz and O. Grau, New methods of image capture to support advanced post-production, Proc. International Broadcasting Convention, Amsterdam, Netherlands, September 2003.
- O. Grau, R. Koch, F. Lavagetto, M. Milne, E. Murphy, M. Price, O. Razzoli, A. Sarti, L. Spallarossa, S. Tubaro, J. Woetzel, New production tools for the planning and the on-set visualisation of virtual and real scenes, Proc. International Broadcasting Convention, Amsterdam, Netherlands, September 2003.
- M. Price, J. Chandaria, O. Grau, G.A. Thomas, D. Chatting, J. Thorne, G. Milnthorpe, P. Woodward, L. Bull, E-J. Ong, A. Hilton, J. Mitchelson, J. Starck, Real-time production and delivery of 3D media, Proc. International Broadcasting Convention, Amsterdam, Netherlands, September 2002.
- BBC Research: http://www.bbc.co.uk/rd/projects/virtual/publications.shtml
Acceptance of AR applications