Research Issue: Ubiquitous Augmented Reality - UAR

Fachgebiet Augmented Reality (FAR)

General Description

Our research focus lies on bringing AR technology into real applications. To this end, we look not only at "classical AR" solutions but consider suitable variations, thereby combining AR with concepts of mobile and ubiquitous computing. This leads to the concept of Ubiquitous Augmented Reality.

Associated People

• Permanent Staff: Florian Echtler, Gudrun Klinker, Daniel Pustka
• External Collaborators: Benjamin Becker (EADS), Peter Keitler, Michael Schlegel
• Former Team Members: Martin Bauer

Associated Projects

trackframe

Use of AR technology in wide-range industry plants requires a tracking framework which supports a fusion of various tracking technologies based on careful evaluations of tradeoffs between technical requirements and costs. It is the goal of the trackframe project to systematically develop the formal basis of a tracking framework. The concept is expected to consider algorithmic and data-related standards via which tracking systems can be dynamically merged. Furthermore, trackframe aims at providing concepts towards the analysis of quality criteria (such as error statistics for individual sensors) and towards supporting AR-engineers in planning improvements to their tracker configuration. Three demonstrators will exhibit trackframe concepts in industrial and academic setups. (Bayerische Forschungsstiftung (BFS))

DWARF - Augmented Reality Framework

DWARF is a CORBA based framework that allows the rapid prototyping of distributed Augmented Reality applications. Augmented Reality is a new way for humans and computers to interact: real-world scenes are augmented with virtual objects. The augmented scene can, for example, be presented to the user through a see-through head-monted display. DWARF is a Framework for the development of such systems: a collection of intelligent modules that can be combined flexibly depending on the needs of the desired application.
The project started in July 2000.

Associated Publications

	G. Klinker Augmented Reality and Industry (original title: Ubiquitous Augmented Reality) Keynote speech. The 14th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2015), Fukuoka, Japan, Sep. 29, 2015. (bib)
	M. Huber, M. Schlegel, G. Klinker Application of Time-Delay Estimation to Mixed Reality Multisensor Tracking Journal on Virtual Reality and Broadcasting (JVRB), Volume 11, 2014, online (22 pages), http://www.jvrb.org/past-issues/11.2014/3877 (bib)
	C. Waechter, D. Pustka, G. Klinker Real-Time Monocular People Tracking by Sequential Monte-Carlo Filtering 6th International ACM Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications (MIRAGE), Berlin, Germany, i4, June 2013 (bib)
	D. Pustka, J. Hülß, J. Willneff, F. Pankratz, M. Huber, G. Klinker Optical Outside-In Tracking using Unmodified Mobile Phones The Eleventh IEEE and ACM International Symposium on Mixed and Augmented Reality, Atlanta, Georgia, Nov. 5 - 8, 2012, pp. 81-89. (bib)
	J.-M. Normand, M. Sanchez-Vives, C. Waechter, E. Giannopoulos, B. Grosswindhager, B. Spanlang, C. Guger, G. Klinker, M. Srinivasan, M. Slater Beaming into the Rat World: Enabling Real-Time Interaction between Rat and Human Each at Their Own Scale PLoS ONE, Public Library of Science, Oct. 2012, Volume 7, Issue 10, e48331 (bib)
	M. Huber, M. Schlegel, G. Klinker Temporal Calibration in Multisensor Tracking Setups 9. Workshop der GI-Fachgruppe Virtuelle und Erweiterte Realität (VR-AR 2012), Düsseldorf, Germany, Sept. 2012, pp. 201-212. (bib)
	M. Schlegel Zeitkalibrierung für Augmented Reality Anwendungen Dissertation (PhD thesis), Fakultät für Informatik, Technische Universität München, December 2011 (online version) (bib)
	M. Huber Parasitic Tracking for Ubiquitous Augmented Reality Dissertation (PhD thesis), Fakultät für Informatik, Technische Universität München, November 2011 (online version) (bib)
	D. Pustka, M. Huber, C. Waechter, F. Echtler, P. Keitler, J. Newman, D. Schmalstieg, G. Klinker Automatic Configuration of Pervasive Sensor Networks for Augmented Reality IEEE Pervasive Computing, Volume 10, Number 3, July-Sept. 2011, pp. 68-79. (bib)
	P. Keitler Management of Tracking and Tracking Accuracy in Industrial Augmented Reality Environments Dissertation (PhD thesis), Fakultät für Informatik, Technische Universität München, April 2011 (online version) (bib)
	C. Waechter, E. Artinger, M. Duschl, G. Klinker Creating Passion for Augmented Reality Applications - a Teaching Concept for a Lab Course 6th International Symposium on Visual Computing (ISVC), Las Vegas, Nevada, USA, Nov. 29th - Dec. 01st, 2010, pp. 429-438. (bib)
	P. Keitler, D. Pustka, M. Huber, F. Echtler, G. Klinker Management of Tracking for Mixed and Augmented Reality Systems The Engineering of Mixed Reality Systems, E. Dubois, P. Gray, L. Nigay (eds.), Human-Computer Interaction Series, Springer Verlag, 2010. (bib)
	C. Waechter, M. Huber, P. Keitler, M. Schlegel, D. Pustka, G. Klinker A Multi-Sensor Platform for Wide-area Tracking 9th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Seoul, Korea, Oct. 13-16, 2010, pp. 275-276. (bib)
	L. Gruber, S. Gauglitz, J. Ventura, S. Zollmann, M. Huber, M. Schlegel, G. Klinker, D. Schmalstieg, T. Höllerer The City of Sights: Design, Construction and Measurement of an Augmented Reality Stage Set The Ninth IEEE and ACM International Symposium on Mixed and Augmented Reality, Seoul, Korea, Oct. 13 - 16, 2010, pp. 157-163. (bib)
	D. Pustka, J. Willneff, O. Wenisch, P. Lükewille, K. Achatz, P. Keitler, G. Klinker Determining the Point of Minimum Error for 3DOF Pose Uncertainty Representation The Ninth IEEE and ACM International Symposium on Mixed and Augmented Reality, Seoul, Korea, Oct. 13 - 16, 2010, pp. 37-45. (bib)
	P. Keitler, B. Becker, G. Klinker Management of Tracking for Industrial AR Setups The Ninth IEEE and ACM International Symposium on Mixed and Augmented Reality, Seoul, Korea, Oct. 13 - 16, 2010, pp. 73-82. (bib)
	M. Huber, B. Becker, G. Klinker Location aware computing using RFID infrastructure Int. J. Autonomous and Adaptive Communications Systems, Vol. 3, No. 1, 2010, pp. 23 - 38 (bib)
	P. Keitler, F. Pankratz, B. Schwerdtfeger, D. Pustka, , G. Klinker, C. Rauch, A. Chathoth, J. Collomosse , Y. Song Mobile Augmented Reality based 3D Snapshots Sechster Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR, Braunschweig, 18./19. November 2009 (bib)
	C. Waechter, D. Pustka, G. Klinker Vision based People Tracking for Ubiquitous Augmented Reality Applications 8th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Orlando, FL, USA, Oct. 19-22, 2009, pp. 221-222. (bib)
	P. Keitler, F. Pankratz, B. Schwerdtfeger, D. Pustka, , G. Klinker, C. Rauch, A. Chathoth, J. Collomosse , Y. Song Mobile Augmented Reality based 3D Snapshots The 8th IEEE and ACM International Symposium on Mixed and Augmented Reality, Orlando, Florida, Oct. 19-22, 2009, pp. 199-200. (bib)
	M. Huber, M. Schlegel, G. Klinker Temporal Calibration in Multisensor Tracking Setups 8th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2009), Orlando, USA, October 2009, pp. 177-178 (bib)
	P. Keitler, M. Schlegel, G. Klinker Indirect Tracking to Reduce Occlusion Problems 4th International Symposium on Visual Computing (ISVC), Las Vegas, Nevada, USA, December 2008, pp. 224-235. (bib)
	D. Pustka, G. Klinker Dynamic Gyroscope Fusion in Ubiquitous Tracking Environments The Seventh IEEE and ACM International Symposium on Mixed and Augmented Reality, Cambridge, UK, Sep. 15 - 18, 2008, pp. 13-20. (bib)
	B. Becker, M. Huber, G. Klinker Utilizing RFIDs for Location Aware Computing 5th International Conference on Ubiquitous Intelligence and Computing, UIC 2008, Oslo, Norway, June 23-25, 2008, pp. 216-228. (bib)
	D. Pustka, M. Huber, G. Klinker Integrating Gyroscopes into Ubiquitous Tracking Environments IEEE Virtual Reality, Reno, Nevada, Mar. 8-12, 2008, pp. 283-284. (bib)
	M. Huber, D. Pustka, P. Keitler, F. Echtler, G. Klinker A System Architecture for Ubiquitous Tracking Environments The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 13 - 16, 2007, pp. 211-214. (bib)
	D. Pustka, P. Keitler, M. Huber, F. Echtler, G. Klinker Ubiquitous Tracking for Quickly Solving Multi-Sensor Calibration and Tracking Problems Demonstration at the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, Nov. 14 - 16, 2007 (bib)
	M. Bauer Tracking Errors in Augmented Reality Dissertation (PhD thesis), Fakultät für Informatik, Technische Universität München, September 2007 (online version) (bib)
	J. Newman, A. Bornik, D. Pustka, F. Echtler, M. Huber, D. Schmalstieg, G. Klinker Tracking for Distributed Mixed Reality Environments IEEE VR 2007 Workshop on 'Trends and Issues in Tracking for Virtual Environments', Charlotte, NC, USA, Mar 11, 2007 (bib)
	O. Bimber Projector-based Illumination and Display Techniques Habilitation TU München, March 2007. (bib)
	D. Pustka, M. Huber, M. Bauer, G. Klinker Spatial Relationship Patterns: Elements of Reusable Tracking and Calibration Systems The Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality, Santa Barbara, CA, USA, Oct. 22 - 25, 2006, pp. 88-97. (bib)
	M. Bauer, M. Schlegel, D. Pustka, N. Navab, G. Klinker Interactive Visualization of the Predicted Accuracy of Marker-Based Optical Tracking Systems Demonstration at the Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality, Santa Barbara, CA, USA, Oct. 22 - 25, 2006. (bib)
	M. Bauer, M. Schlegel, D. Pustka, N. Navab, G. Klinker Predicting and Estimating the Accuracy of n-occular Optical Tracking Systems The Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality, Santa Barbara, CA, USA, Oct. 22 - 25, 2006, pp. 43-51. (bib)
	D. Pustka Construction of Data Flow Networks for Tracking in Augmented Reality Applications Dritter Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR, Koblenz, 25.-26. September 2006 (bib)
	G. Hillebrand, M. Bauer, K. Achatz, G. Klinker Inverse Kinematic Infrared Optical Finger Tracking 9th International Conference on Humans and Computers (HC 2006), Aizu, Japan (bib)
	M. Wagner Tracking With Multiple Sensors Dissertation (PhD thesis), Fakultät für Informatik, Technische Universität München, Apr. 2005 (online version) (bib)
	C. Sandor, G. Klinker A Rapid Prototyping Software Infrastructure for User Interfaces in Ubiquitous Augmented Reality Journal for Personal and Ubiquitous Computing, Springer Verlag, 2005, pp. 169-185. The original publication is available online at www.springerlink.com . (bib)
	M. Wagner, S. Hennauer, G. Klinker Easing the Transition Between Multiple Trackers International Symposium on Mixed and Augmented Reality (ISMAR) 2004, Arlington, VA, USA, Nov 2-4, 2004 (bib)
	C. Sandor, B. Bell, A. Olwal, N. Temiyabutr, S. Feiner Visual End User Configuration of Hybrid User Interfaces Demo at International Symposium on Mixed and Augmented Reality (ISMAR) 2004, Arlington, VA, USA, Nov 2-4, 2004 (bib)
	V. Novak, C. Sandor, G. Klinker An AR Workbench for Experimenting with Attentive User Interfaces International Symposium on Mixed and Augmented Reality (ISMAR) 2004, Arlington, VA, USA, Nov 2-4, 2004 (bib)
	J. Newman, M. Wagner, M. Bauer, A. MacWilliams, T. Pintaric, D. Beyer, D. Pustka, F. Strasser, D. Schmalstieg, G. Klinker Ubiquitous Tracking for Augmented Reality International Symposium on Mixed and Augmented Reality (ISMAR) 2004, Arlington, VA, USA, Nov 2-4, 2004, pp. 192-201. (bib)
	C. Sandor, B. Bell, A. Olwal, N. Temiyabutr, S. Feiner Visual End User Configuration of Hybrid User Interfaces Demo description in ACM SIGMM 2004 Workshop on Effective Telepresence, New York, NY, USA, Oct. 15, 2004. (bib)
	A. MacWilliams Software Development Challenges for Ubiquitous Augmented Reality First Virtual and Augmented Reality Workshop of the Gesellschaft für Informatik, Chemnitz, September 2004 (bib)
	M. Wagner Distributed Tracking with Multiple Sensors for Augmented Reality 1. Workshop "Virtuelle und Erweiterte Realität", TU Chemnitz, 27. - 28. September 2004 (bib)
	M. Wagner, A. MacWilliams, M. Bauer, G. Klinker, J. Newman, T. Pintaric, D. Schmalstieg Fundamentals of Ubiquitous Tracking Second International Conference on Pervasive Computing, Hot Spots section, Vienna, Austria, Apr. 18--23 2004 (bib)
	A. MacWilliams, T. Reicher, G. Klinker, B. Bruegge Design Patterns for Augmented Reality Systems Proc. of the International Workshop exploring the Design and Engineering of Mixed Reality Systems - MIXER 2004, Funchal, Madeira, CEUR Workshop Proceedings (bib)
	O. Hilliges, C. Sandor, G. Klinker A Lightweight Approach for Experimenting with Tangible Interaction Metaphors Proc. of the International Workshop on Multi-user and Ubiquitous User Interfaces (MU3I) 2004, Funchal, Madeira (bib)
	J. Newman, M. Wagner, T. Pintaric, A. MacWilliams, M. Bauer, G. Klinker, D. Schmalstieg Fundamentals of Ubiquitous Tracking for Augmented Reality Technical Report TUM-I0323, Technische Universität München; Technical Report TR-188-2-2003-34, Vienna University of Technology (bib)
	M. Wagner, G. Klinker An Architecture for Distributed Spatial Configuration of Context Aware Applications 2nd International Conference on Mobile and Ubiquitous Multimedia, Norrköping, Sweden, Dec. 11-12 2003 (bib)
	A. MacWilliams, C. Sandor, M. Wagner, M. Bauer, G. Klinker, B. Bruegge Herding Sheep: Live System Development for Distributed Augmented Reality Proceedings of The Second International Symposium on Mixed and Augmented Reality (ISMAR 2003), pp. 123-132. (bib)
	M. Wagner, F. L{\"o}w Configuration Strategies of an AR Toolkit-based Wide Area Tracker The Second IEEE International Augmented Reality Toolkit Workshop, Tokyo, Japan, Oct. 7 2003. (bib)
	M. Bauer, O. Hilliges, A. MacWilliams, C. Sandor, M. Wagner, G. Klinker, J. Newman, G. Reitmayr, T. Pintaric, T. Fahmy, D. Schmalstieg Integrating Studierstube and DWARF International Workshop on Software Technology for Augmented Reality Systems. Tokyo, Japan, Oct. 7, 2003 (bib)
	M. Tönnis Data Management for Augmented Reality Applications Master Thesis - Technische Universitaet Muenchen (bib)
	C. Sandor, A. MacWilliams, M. Wagner, M. Bauer, G. Klinker SHEEP: The Shared Environment Entertainment Pasture Demo at IEEE and ACM International Symposium on Mixed and Augmented Reality ISMAR 2002, Darmstadt, Germany, Sept. 30 - Oct. 1, 2002. (bib)
	M. Wagner Building Wide-Area Applications with the AR Toolkit The First IEEE International Augmented Reality Toolkit Workshop, Darmstadt, Germany, Sept. 29 2002. (bib)
	M. Bauer, B. Bruegge, G. Klinker, A. MacWilliams, T. Reicher, C. Sandor, M. Wagner An Architecture Concept for Ubiquitous Computing Aware Wearable Computers International Workshop on Smart Appliances and Wearable Computing. Vienna, Austria, July 2, 2002 (bib)
	M. Bauer, B. Bruegge, G. Klinker, A. MacWilliams, T. Reicher, S. Riß, C. Sandor, M. Wagner Design of a Component-Based Augmented Reality Framework Proceedings of The Second IEEE and ACM International Symposium on Augmented Reality (ISAR 2001), pp. 45-54. (bib)
	M. Wagner DWARF - Design, Prototypical Implementation and Testing of a Real-Time Optical Feature Tracker Diplomarbeit (bib)
	A. MacWilliams Using Ad-Hoc Services for Mobile Augmented Reality Systems Diplomarbeit (bib)