TeachingSs20ArSeminar

Anwendungen der Augmented Reality

by David A. Plecher and Prof. Gudrun Klinker, Ph.D

Abstract

Augmented Reality (AR) is a new technology which superimposes virtual information onto the real environment. The information is displayed in 3D and seamlessly integrated in the user's view of the scene.

This proseminar shall provide students with an overview on "classical" approaches and applications of Augmented Reality. In each session papers which are representative for different aspects of AR are discussed. Each participant has to prepare such a talk (~30 min), present it and discuss it with the group.

Erweiterte Realität (Augmented Reality, AR) ist eine neue Technologie, die die reale Umgebung mit virtuellen Informationen anreichert. Die Informationen werden hierbei 3-dimensional und lagegerecht in das Sichtfeld des Benutzers eingeblendet.

In diesem Proseminar sollen Studierende einen Überblick über "klassische" Ansätze und Anwendungen von AR gewinnen. Hierzu wird bei jedem Veranstaltungstermin ein oder mehrere repräsentative Papers zu verschiedenen Aspekten der AR besprochen. Die Aufgabe jedes Teilnehmers besteht dabei darin, einen solchen Vortrag (ca. 30 min) zu halten und mit der Gruppe zu diskutieren.

Organisation

• Das Seminar besteht aus 20 Vorträgen über eine Auswahl der unten aufgeführten Themen
• Das Seminar wird wöchentlich abgehalten.
• 1-2 Vorträge pro Seminar
• Dienstag von 14:00 - 16:00h
• Raum: virtuell in Zoom - Link siehe Email

• Jeder Teilnehmer hält einen ca. 30-minütigen Vortrag.

Anforderungen

• Gut vorbereiteter Vortrag (~30 Min) mit anschließender Diskussion
• Handout (3-5 Seiten)
• Anwesenheit bei mindestens 10 Veranstaltungen
  • Lebhafte Beteiligung an der Diskussion zu den Vorträgen (Anmerkung: Die Fähigkeit zur kritischen und interessierten Aufnahme und Diskussion neuer Ideen ist ein Lernziel dieser Veranstaltung. Es gibt keine dummen Fragen. Es ist auch ok, zu einem Vortragsthema Bedenken zu äußern.)
• Sprache für Vortrag, Folien und Handout: Deutsch oder (gerne auch!) Englisch

Zeitplanung zur Vorbereitung auf den eigenen Vortrag

• 2 Wochen vor dem Vortrag: Gliederung und Literaturliste
• 1 Woche vor dem Vortrag: Folien (Template - Beispiel)
• 1 Woche vor dem Vortrag: Handout (3-5 Seiten)

Termine

Termin	Thema	Vortragende(r)

28.04.2020	KickOff?
05.05.2020	-
12.05.2020	Displays/Tracking	Bott/Betzer
19.05.2020	Military/Movies&TV	Gottschalk/Olescher
26.05.2020	Advertisement/Commerce	Rhouma/Quan
09.06.2020	Education&Training	Knop/Schorr
16.06.2020	Maintanance/Acceptance	Pernsteiner/Deusch
23.06.2020	Medical AR	Moser/Großmann
30.06.2020	supporting sports/Tabletop	Koch/Goldstein
07.07.2020	production and planning/ Books	Mokni/Engelmann
14.07.2020	Exhibits & Museum	Arnold/Griesbeck
21.07.2020	(Serious) Games/Emergency	Rendenbach/Quian

Themen

• AR Display Technologies (HW)
• AR Displays and Projectors (visualization techniques)
• Tracking and Modelbuilding Technologies for AR
• AR-Definitions, Taxonomies

• AR for Emergency Assistance Situations
• Military AR
• Tabletop AR
• AR in Exhibits & Museums
• AR in Movies & TV
• AR in Education and Training
• AR for Service and Maintenance
• Medical AR
• Handheld AR
• AR for Commerce (Shopping Assistant)
• AR for Advertisement
• AR in Books / Print Media (Advertisement)
• AR for production and planning
• Acceptance of AR application
• AR supporting sports (visualization of critical situations, analytics)
• AR in (Serious) Games

Introduction to AR (general reading for everybody)

• R. Azuma,
  A Survey of Augmented Reality
• R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. Macintyre,
  Recent Advances in Augmented Reality
• D. Schmalstieg, T. Höllerer: Augmented Reality: principles and practice

Anmerkungen:

• Da Augmented Reality ein sehr international geprägtes Gebiet ist, sind die bereitgestellten Unterlagen überwiegend in Englisch.
• Das aufgeführte Material reicht für mehr als einen Vortrag pro Thema. Der Umfang einzelner Vorträge wird in der Vorbesprechung, bzw. in Einzelbesprechungen während der Vorbereitungsphase festgelegt.
• Es wird erwartet, dass sich Vortragende selbstständig weitergehend zum ausgewählten Themabereich informieren und neuestes Material (z.B.: Videos oder Bilder) hinzufügen.

1. AR-Definitions, Taxonomies

• P. Milgram et al. - augmented reality
• M. Tönnis, D. A. Plecher - Presentation Principles

2. Displays and projectors - visualization techniques

• first Head-Mounted Display by Ivan Sutherland (1968)
• J. Rolland and O. Cakmakci The past, present, and future of head-mounted display designs. Proc. SPIE, 5638:368–377, 2004.
• O. Cakmakci and J. Rolland,
  Head-worn displays: A review.
  IEEE Journal of Display Technologies, 2(3):199–216, 2006.
• Viirre, E., Pryor, H., Nagata, S., Furness, T. A. (1998),
  The Virtual Retinal Display: A New Technology for Virtual Reality and Augmented Vision in Medicine
• O. Bimber, R. Raskar; Spatial Augmented Reality: Merging Real and Virtual Worlds; A. K. Peters, Ltd., Natick, MA, USA, 2005, Kapitel 8

3. Tracking and calibration - how to get those objects in the right place

• Rolland, J.P., L. Davis, and Y. Baillot, A Survey of Tracking Technology for Virtual Environments, in Augmented Reality and Wearable Computers, Ch. 3, Ed. Barfield and Caudell, Mahwah, NJ., 2001.
• Gary Bishop, Greg Welch, and B. Danette Allen, Tracking: Beyond 15 Minutes of Thought, SIGGRAPH 2001 Course Notes
• Greg Welch, Eric Foxlin, Motion Tracking: No Silver Bullet, but a Respectable Arsenal IEEE Computer Graphics and Applications, 22 (6), Nov/Dec 2002

4. AR Movies and TV

• New production tools for the planning and the on-set visualisation of virtual and real scenes O. Grau, R. Koch, F. Lavagetto, M. Milne, E. Murphy, M. Price, O. Razzoli, A. Sarti, L. Spallarossa, S. Tubaro, J. Woetzel, Proc. International Broadcasting Convention, Amsterdam, Netherlands, September 2003.

• MHP Oriented Interactive Augmented Reality System for Sports Broadcasting Environments Olaizola, I. G., Martirena, I. B., Kammann, T. D., and Germany, U. K. Journal of Virtual Reality and Broadcasting 3

5. AR for military applications

• M. Livingston et al.,
  An Augmented Reality System for Military
• S. Julier, Y. Baillot, M. Lanzagorta, D. Brown et al.,
  BARS: Battlefield Augmented Reality System
• J. Hicks, R. Flanagan, P. Petrov, A. Stoyen,
  Eyekon: Distributed Augmented Reality for Soldier Teams

6. Commerce/Advertisement

• Augmented Reality E-Commerce Assistant System: Trying While Shopping. Lu, Y. & Smith, S.
  HumanComputer^? Interaction Interaction Platforms and Techniques 4551, 643-652 (2007).
• Design of the PromoPad^? : an Automated Augmented Reality Shopping Assistant.
  Zhu, W., Owen, C.B., Li, H. & Lee, J.-hyun
  East 20, 1-16 (2006).
  
  

• D. Schmalstieg, M. Billinghurst: Augmented Reality 2.0
• F. Chehimi et al.: Augmented reality 3d interactive advertisements on smartphones

7. AR for education and training

• X. Zhong, P. Boulanger, N. Georganas,
  Collaborative Augmented Reality: A Prototype for Industrial Training
• B. Schwald, B. de Laval,
  An Augmented Reality System for Training and Assistance to Maintenance in the Industrial Context
• P. Boulanger,
  Application of Augmented Reality to Industrial Tele-Training
• R. Bischoff, A. Kazi,
  Perspectives on augmented reality based human-robot interaction with industrial robots
• C. Hughes, C. Stapleton, D. Hughes, E. Smith,
  Mixed Reality in Education, Entertainment and Training
• H. Kaufmann,
  Collaborative Augmented Reality in Education
• M. Billighurst,
  Augmented Reality in Education

8. AR for service and maintenance

• Friedrich, Wolfgang (Hrsg.)
  ARVIKA - Augmented Reality in Entwicklung, Produktion und Service
• S. Feiner, B. Macintyre, D. Seligmann,
  Knowledge-based Augmented Reality
• A. Janin, D. Mizell, T. Caudell,
  Calibration of head-mounted displays for augmented reality
• J. Platonov, H. Heibel, P. Meier, B. Grollmann
  A mobile markerless AR system for maintenance and repair

9. AR for medical applications: Surgery

• M. Feuerstein, S.M. Wildhirt, R. Bauernschmitt, N. Navab,
  Automatic Patient Registration for Port Placement in Minimally Invasive Endoscopic Surgery
  Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2005), Palm Springs, USA, October 2005
• R. Bauernschmitt, M. Feuerstein, E.U. Schirmbeck, J. Traub, G. Klinker, S.M. Wildhirt, R. Lange
  Improved Preoperative Planning in Robotic Heart Surgery
  IEEE Proceedings of Computers in Cardiology (CinC^? 2004), pp. 773 - 776, Chicago, USA, September 2004
• J. Traub, M. Feuerstein, M. Bauer, E.U. Schirmbeck, H. Najafi, R. Bauernschmitt, G. Klinker
  Augmented Reality for Port Placement and Navigation in Robotically Assisted Minimally Invasive Cardiovascular Surgery
  Proceedings of Computer Assisted Radiology and Surgery (CARS 2004), pp. 735 - 740, Chicago, USA, June 2004
• Publikationen auf http://campar.in.tum.de/Chair/ProjectCamC
• G. Stetten, D. Shelton, W. Chang, V. Chib, R. Tamburo, D. Hildebrand, L. Lobes, J. Sumkin,
  Towards a clinically useful Sonic Flashlight,
  IEEE International Symposium on Biomedical Imaging 2002

10. Acceptance of AR applications

• H. Regenbrecht,
  Industrial Augmented Reality Applications
• N. Navab,
  Industrial Augmented Reality: Challenges in Design and Commercialization of Killer Apps
• N. Navab,
  Developing killer apps for industrial augmented reality

11. Sports

• A real-time augmented-reality system for sports broadcast video enhancement Han, J. and Farin, D. and others Proceedings of the 15th international conference on Multimedia, ACM, 2007
• A vision-based mobile augmented reality system for baseball games Lee, S.O. and Ahn, S. and Hwang, J.I. and Kim, H.G. Virtual and Mixed Reality-New Trends, Springer, 2011

12. Tabletop Mixed Reality Interfaces

• one of the first: P. Wellner,
  Interacting with paper on the DigitalDesk
• very widely known: J. Han,
  Low-cost multi-touch sensing through FTIR
• J. Rekimoto,
  SmartSkin^?: an infrastructure for freehand manipulation on interactive surfaces
• H. Ishii, B. Ullmer,
  Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms
• S. Greenberg, C. Fitchett,
  Phidgets: easy development of physical interfaces through physical widgets
• M. Kaltenbrunner, R. Bencina,
  reacTIVision: a computer-vision framework for table-based tangible interaction

13. AR for production and planning

• F. Echtler, F. Sturm, K. Kindermann, G. Klinker, J. Stilla, J. Trilk, H. Najafi,
  The Intelligent Welding Gun: Augmented Reality for Experimental Vehicle Construction
• F. Doil, W. Schreiber, T. Alt, C. Patron,
  Augmented reality for manufacturing planning
  ACM Proceedings of the Eurographics Workshop on Virtual Environments 2003
• K. Pentenrieder, F. Doil, C. Bade, P. Meier,
  Augmented Reality based factory planning - an application tailored to industrial needs
  The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 13 - 16, 2007

14. Exhibits & Museums

• Archeoguide Project
• Pompeii: LifePlus
• Frauenhofer: CHESS

• Museums and AR

15. Books:

• Alice in Wonderland
• Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The MagicBook: a transitional AR interface. Computers & Graphics, 25(5), 745-753.

16. Games

• Wayne Piekarski, Bruce Thomas: ARQuake
• Thomas, B. H. (2012). A survey of visual, mixed, and augmented reality gaming. Computers in Entertainment (CIE), 10(1), 3. A Survey of Visual, Mixed, and Augmented Reality Gaming
• Chek Tien Tan, Donny Soh: https://www.researchgate.net/profile/Chek_Tien_Tan/publication/260480270_Augmented_Reality_Games_A_Review/links/56fb0b0708ae3c0f264c08b3.pdf
• Plecher et al.: Dragon Tale - A Serious Game for Learning Japanese Kanji: https://dl.acm.org/doi/abs/10.1145/3270316.3271536

17. AR for Emergency:

• Using AR to Support Cross-Organisational Collaboration in Dynamic Tasks Nilsson, Susanna, Bjeorn J. E. Johansson und Arne Jonsson Engineering (1) p. 3-12, 2009
• Augmented Cognition for Fire Emergency Response: An Iterative User Study Daniel Steingart, Joel Wilson, Andrew Redfern, P Wright, Russell Romero, Lloyd Lim (2005) Augmented Cognition (March 2002) p. 22-27