Augmented Reality

Augmented Reality (AR) is a newly emerging technology  by which a user's view of the real world is augmented with additional information from a computer model. With mobile, wearable computers, users can access information without having to leave their work place. They can manipulate and examine real objects  and simultaneously receive additional information about them or the task at hand. Using Augmented Reality technology, the information is presented three-dimensionally integrated into the real world. Exploiting people's visual and spatial skills to navigate in a three-dimensional world, Augmented Reality thus constitutes a particularly promising new user interface paradigm.

Research in Augmented Reality and wearable computing is beginning to receive more and more attention due to striking progress in  many subfields and fascinating live demonstrations (due to advances in computer miniaturization, mobile networking, and sensing technology). Augmented Reality, by its very nature, is a highly inter-disciplinary field, and Augmented Reality researchers work in areas such as signal processing, computer vision, graphics, user interfaces,  wearable computing, mobile computing, computer networks, distributed computing, information access, information visualization, software engineering, and the design of new displays.

Research Issues

Augmented Reality is a new research activity which explores various approaches to augment a user's view of the real world with additional information. By combining live video input with immersive display technology, Augmented Reality allows users to work with and examine real 3D objects while seeing additional information about the objects or the task at hand. Augmented Reality can be applied in many sectors of industry, e.g., for repairing and maintenance of complex machines and facilities, visualizing sensor or simulation data, and for interior design.

Alignment between real and virtual world

Before overlaying synthetic information on an image, the 3D viewing parameters of the real and synthetic camera must be aligned. To this end, the real camera or the user head-mounted display has to be calibrated and tracked over time. Additionally, all used coordinate systems of the tracking system and the world model have to be calibrated as well.

Information visualization

Depending on the application scenario, architects or construction workers need access to various kinds of data, e.g: what the final building will look like, where and how particular parts are to be attached, what the schedule is, and which colleagues and other companies are involved.

The Augmented Reality system needs to access the relevant information and present it appropriately, e.g. as a wireframe, as fully rendered objects, or as text-based annotations that could serve as active links to retrieve further information or to establish direct communication channels with collaborators.

Interaction between real and virtual objects

Realistic immersion of virtual objects into a real scene requires that the virtual objects behave in physically plausible manners: they occlude or are occluded by other objects, they are not able to move through other objects, and they cast shadows on other objects. Augmented Reality Systems need very detailed descriptions of the real environment to simulate such physical constraints.

3D user interaction

In an Augmented World, users need new multi-media and 3D user interaction schemes to communicate with the computer: they are away from their keyboard, and computer interaction has to integrate well into the daily work patterns of the user.

Real-time processing

In Augmented Reality, objects have to be tracked and information has to be rendered in real time. This constraint supersedes all other considerations for pretty and detailed information visualization or user interaction paradigms. In this respect, the chosen approach depends on priorities defined by specific application scenarios.

Links

• Augmented Reality Further Reading^? (literature suggestions for further reading)
• The DWARF Annotated Augmented Reality Bibliography

Links to related research:

• Jun Rekimoto's list of AR sites
  http://www.csl.sony.co.jp/projects/ar/ref.html
• Jim Vallino's list of AR sites
  http://www.se.rit.edu/~jrv/research/ar/
• MIT list of wearable computing activities worldwide
  http://www.media.mit.edu/wearables/lizzy/wearlinks.html
• Intelligent Environments Resource Page
  http://www.research.microsoft.com/ierp/
• Computer Vision Home Page
  http://www.cs.cmu.edu/~cil/vision.html
• Computer Graphics, Visualization and Virtual Reality
  http://mambo.ucsc.edu/psl/cg.html

Conferences & Journals

Conferences and special issues of Journals:

Journals

• Communications of the ACM, Special issue on computer augmented environments: back to the real world, Vol. 36, No. 7, July 1993.
• Presence,  Presence, special Issue on Augmented Reality, Vol 6, No. 4, August 1997. 

ISMAR Series

• 1. International Workshop on Augmented Reality  (IWAR'98), San Francisco, Nov. 1998.
• 2. International Workshop on Augmented Reality (IWAR'99), San Francisco, Oct. 1999.
• 1. International Symposium on Mixed Reality (ISMR'99), Yokohama, Japan, March 1999.
• 1. International Symposium on Augmented Reality (ISAR 2000), Munich, Oct. 2000.
• 2. International Symposium on Mixed Reality (ISMR'01), Yokohama, Japan, March 2001.
• 2. International Symposium on Augmented Reality (ISAR 2001), New York, Oct. 2001.
• 1. International Symposium on Mixed and Augmented Reality (ISMAR 2002), Darmstadt, Oct. 2002.
• 2. International Symposium on Mixed and Augmented Reality (ISMAR 2003), Tokyo, Oct. 2003.
• 3. International Symposium on Mixed and Augmented Reality (ISMAR 2004), Arlington, VA, Nov. 2004.
• 4. International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Oct. 2005.
• 5. International Symposium on Mixed and Augmented Reality (ISMAR 2006) Santa Barbara, Oct. 2006.
• 6. International Symposium on Mixed and Augmented Reality (ISMAR 2007) Nara, Japan, Nov. 2007.

ISWC Series

• 1. International Symposium on Wearable Computers ( ISWC'97 ),  Oct 1997.
• 2. International Symposium on Wearable Computers ( ISWC'98 ), Oct. 1998.
• 3. International Symposium on Wearable Computers ( ISWC'99 ), Oct. 1999.
• 4. International Symposium on Wearable Computers ( ISWC'00 ), Atlanta, Oct. 2000.
• 5. International Symposium on Wearable Computers ( ISWC'01 ), Zürich, Oct. 2001.
• 6. International Symposium on Wearable Computers ( ISWC'02 ), Seattle, Oct. 2002.
• 7. International Symposium on Wearable Computers ( ISWC'03 ), White Plains (NY), Oct. 2003.

Ubicomp Series

• 1. International Symposium on Handheld and Ubiquitous Computing ( HUC'99 ),Karlsruhe, Sept. 1999.
• 2. International Symposium on Handheld and Ubiquitous Computing ( huc2k  ), Bristol, Sept. 2000.
• 3. International Conference on Ubiquitous Computing ( Ubicomp 01 ), Atlanta, Sept. 2001.
• 4. International Conference on Ubiquitous Computing ( Ubicomp 2002 ), Göteborg, Sept. 2002.
• 5. International Conference on Ubiquitous Computing ( Ubicomp 2003 ), Seattle, Sept. 2003.