PublicationDetail

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

C. Sandor, T. Reicher
CUIML: A Language for Generating Multimodal Human-Computer Interfaces
Proceedings of the European UIML Conference, 2001 (bib)

CUIML, the Cooperative User Interfaces Markup Language, was developed as part of the DWARF project. The goal of DWARF is the development of a framework for augmented reality applications running on wearable computers. For wearable systems, the HCI (human-computer interface) consists of numerous I/O devices such as head mounted displays, palm-size devices, and speech recognition systems. This should lead to a multimodal interaction with the user. To make the development of multimodal user interfaces easier, we propose a unified user interface description language. This language describes the user interface in an abstract way and allows to map it to different output and input components. To keep the different parts of the user interface in a consistent state, a controller object is needed. We used UIML, the User Interface Markup Language, as a starting point. CUIML o ers an abstract description language for the views and the controller. By XSL transformations, these presentation free HCI descriptions are converted to markup languages that can be displayed on the various I/O devices. Furthermore the controller, whose internal structure is a deterministic finite automaton (DFA), is also con gured by CUIML. CUIML is a promising approach to solving the problems that occur, when developing a multimodal HCI. On a higher level of abstraction CUIML is a description language for views and controllers of the MVC (Model/View/Controller) design pattern that can be transformed to the required structures at runtime. Because it is based on XML it can be extended easily to support many di erent wearable systems.
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each authors copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.



Edit | Attach | Refresh | Diffs | More | Revision r1.13 - 30 Jan 2019 - 15:16 - LeslieCasas

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif