Interactive Media Systems, TU Wien

Agents That Talk And Hit Back: Animated Agents in Augmented Reality

By István Barakonyi, Thomas Psik, and Dieter Schmalstieg


AR Puppet is a hierarchical animation framework for Augmented Reality agents, which is a novel research area combining Augmented Reality (AR), Sentient Computing and Autonomous Animated Agents into a single coherent human-computer interface paradigm. While Sentient Computing systems use the physical environment as an input channel, AR outputs virtual information superimposed on real world objects. To enhance man-machine communication with more natural and efficient information presentation, this framework adds animated agents to AR applications that make autonomous decisions based on their perception of the real environment. These agents are able to turn physical objects into interactive, responsive entities collaborating with both anthropomorphic and non-anthropomorphic virtual characters, extending AR with a previously unexplored output modality. AR Puppet explores the requirements for context-aware animated agents concerning visualization, appearance, behavior, in addition to associated technologies and application areas. A demo application with a virtual repairman collaborating with an augmented LEGO® robot illustrates our concepts.


I. Barakonyi, T. Psik, D. Schmalstieg: "Agents That Talk And Hit Back: Animated Agents in Augmented Reality"; in: "Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality 2004", IEEE Computer Society, 2004, 141 - 150.


Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.