ATTENTION: This is a web archive! The IMS Group was split up in 2018 and does not exist anymore. Recent work of former members can be found at the VR/AR Group and the Computer Vision Group.

Interactive Media Systems, TU Wien

Virtual and Augmented Reality

Contact: Hannes Kaufmann

We conduct basic and application oriented research in all areas related to virtual and augmented reality.

Completed

Research Projects

Einsatz von Augmented Reality zur Abnahme und Qualitätssicherung auf Baustellen Einsatz von Augmented Reality zur Abnahme und Qualitätssicherung auf Baustellen   (“AR-AQ-BAU”)
H. Kaufmann — October 2018 to September 2020
The aim of this research project is the development of a construction site-suitable augmented reality (AR) system for improving the quality of…

Systematic Evaluation for AR Controllers Systematic Evaluation for AR Controllers   (“EvaluARte”)
H. Kaufmann — August 2017 to July 2019 • Keywords: Augmented Reality, 3D Interaction, AR Controller, UI Widget, AR Displays
Augmented Reality (AR) glass users have a direct view of the real environment while computer-generated information is superimposed on the…

Realistic Indoor Path Visualization with Real-Time Obstacle Avoidance in Augmented Reality Realistic Indoor Path Visualization with Real-Time Obstacle Avoidance in Augmented Reality   (“ARPathVis”)
H. Kaufmann — March 2016 to August 2018 • Keywords: Indoor Navigation, Augmented Reality, Mobile Devices
Accurate navigation systems for large indoor environments utilizing visual features, which are able to provide real time 3D positions and rotations,…

Virtual Simulation and On-Site Training for First Responders Virtual Simulation and On-Site Training for First Responders   (“VR on-site”)
H. Kaufmann — July 2015 to December 2017 • Keywords: Virtual Reality, Immersive, First Responders, Training, Multi-User, Collaboration
The project’s goal is to develop and evaluate the first fully mobile, generic, multi-user immersive virtual reality platform to train squad leaders…

Flexible Spaces: Dynamic Layout Generation for Infinite Walking in Virtual Environments Flexible Spaces: Dynamic Layout Generation for Infinite Walking in Virtual Environments
H. Kaufmann — December 2011 to December 2017 • Keywords: Virtual Reality, Redirected Walking, Impossible Spaces, Change Blindness
Redirected walking techniques enable natural locomotion through immersive virtual environments (VEs) that are larger than the real world workspace.…

Automated Architectural 3D Model Generation for Virtual Reality Walk-Through Automated Architectural 3D Model Generation for Virtual Reality Walk-Through   (“Virtual Architect”)
H. Kaufmann — July 2015 to June 2017
This project addresses the interactive virtual exploration of buildings. Virtual walkthroughs of property are becoming increasingly popular in the…

Material Reconstruction and High Quality, Angle-Dependent Real-Time Visualization on Mobile Devices Material Reconstruction and High Quality, Angle-Dependent Real-Time Visualization on Mobile Devices   (“MobileBRDF”)
H. Kaufmann — January 2014 to December 2015
The quality of synthetic, photorealistic images depends crucially on the quality of the materials that are used and shown. A customer expects…

Multimodal Feedback for Supporting Gestural Interaction in Smart Environments Multimodal Feedback for Supporting Gestural Interaction in Smart Environments   (“Life-Stage”)
H. Kaufmann — January 2014 to December 2015
The smart environments of our future ubiquitous computing era need to deliver their users with appropriate interfaces that go beyond today’s standard…

Virtual Reality Training for CBRN-Defense and First Responders Virtual Reality Training for CBRN-Defense and First Responders   (“VR-Defensetraining”)
A. Mossel, H. Kaufmann — October 2014 to September 2015 • Keywords: Virtual Reality, Training, CBRN-Defense
In this project we investigate how Virtual Reality (VR) technologies can be utilized to enhance the quality of training, reduce costs and increase…

Development of a Didactic Concept for Modern 3D Geometry Teaching Materials Development of a Didactic Concept for Modern 3D Geometry Teaching Materials   (“GEODIKON”)
H. Kaufmann — November 2012 to December 2014 • Keywords: Geometry Education, teaching materials, Spatial Abilities
In GEODIKON we work on a didactic and methodic design of modern 3D geometry teaching material, especially for mathematics courses and "Linear…

High-Quality Real-Time Global Illumination in Augmented Reality High-Quality Real-Time Global Illumination in Augmented Reality   (“RayEngine”)
P. Kán — January 2010 to December 2014 • Keywords: Augmented Reality, High-quality rendering, Photorealistic rendering, Visual coherence
In this research we aim to examine using high-quality rendering techniques in augmented reality scenario. We use ray-tracing based rendering to…

Mobile Hybrid Tracking in Large and Changing Interior Spaces Mobile Hybrid Tracking in Large and Changing Interior Spaces   (“HyMoTrack”)
H. Kaufmann — January 2013 to December 2014 • Keywords: light field camera, mobile tracking, SLAM
The goal of this project is to develop a hybrid indoor tracking system for mobile devices like smartphones or tablets. The system will be…

Conceptional Development of image recognition engine for outdoor 3D objects on smartphones Conceptional Development of image recognition engine for outdoor 3D objects on smartphones   (“MusketIR”)
H. Kaufmann — February 2013 to October 2014 • Keywords: Mobile Tracking, Large Scale Tracking, 3D Outdoor Object Recognition, SLAM
The goal of this project is not only to track, but also to recognize 3 dimensional structures in open space with the use of devices like smartphones…

Evaluation of Modular Actuated Tangible User Interfaces Evaluation of Modular Actuated Tangible User Interfaces   (“ACTO”)
H. Kaufmann — September 2012 to September 2014 • Keywords: tabletop interaction, widgets, haptics, actuation, prototyping platform, Tangible User Interfaces
"Tangible Computing" is an active area of research in the field of human-computer-interaction. Its intention is the design of intuitive and…

A Framework for the Design and Development of Multimodal Interaction on Tabletops A Framework for the Design and Development of Multimodal Interaction on Tabletops   (“MINT”)
T. Pintaric — January 2009 to December 2012 • Keywords: Multi-touch, Gesture-based Interaction Framework, Infrared Optical Tracking
Innerhalb des MINT-Projekts sollen neuartige Methoden zur Generalisierung komplexer Interaktionstechniken mit speziellem Fokus auf Gesten-basierte…

Real-time Tunneling Measurement based on Infrared Optical Tracking Real-time Tunneling Measurement based on Infrared Optical Tracking   (“RTMIOT”)
A. Mossel — January 2009 to December 2012 • Keywords: Tunnel Measurement System, Realtime Infrared Optical Tracking
This project develops a system to perform tunneling measurement in real time based on optical infrared tracking. This stereo measurement system,…

Virtual Reality Training for Upper Limb Prosthesis Patients Virtual Reality Training for Upper Limb Prosthesis Patients   (“Arm Prosthesis”)
H. Kaufmann — January 2011 to October 2012 • Keywords: Virtual Reality, Virtual Rehabilitation, Serious Gaming, 6DOF Interaction, Bio Sensor, ARTiFICe, iotracker
The initial fitting of an upper limb prosthesis can be a frustrating experience for amputees, impairing the learning of prosthesis control.…

ProFiTex - Providing Fire Fighters with Technology for Excellent Work Safety ProFiTex - Providing Fire Fighters with Technology for Excellent Work Safety
H. Kaufmann — October 2009 to September 2012 • Keywords: work safety, protective clothing, Fire brigade, textile-based system, emergency responders, personal protective equipment
The aim of project ProFiTex is to support fire fighters in their perilous work with a system that supplies mission-relevant information without…

Visual Tracking in historical buildings Visual Tracking in historical buildings   (“Hofburg Tracking”)
H. Kaufmann — October 2011 to August 2012 • Keywords: Tracking, Historical Buildings, Optical Tracking
Gegenstand des geförderten Vorhabens ist die Entwicklung und Implementierung eines neuartigen Algorithmus für mobile Endgeräte zur genauen…

Playmancer Playmancer
H. Kaufmann — January 2007 to December 2011 • Keywords: Serious Gaming, Motion Capturing, Virtual Reality Rehabilitation, Infrared Optical Tracking
PlayMancer will implement a new Serious Game environment by augmenting existing 3D gaming engines with new possibilities. The objectives of the…

Immersive interface technologies for life-cycle human-oriented activities in interactive aircraft-related virtual products Immersive interface technologies for life-cycle human-oriented activities in interactive aircraft-related virtual products   (“Vision”)
C. Breiteneder — November 2008 to June 2011 • Keywords: interaction, Visualization, virtual cockpit, virtual cabin, immersion
Although Virtual Reality (VR) has demonstrated a significant potential for interactive applications on product and process development, the proven…

Affordable Infrared-Optical Pose Tracking Affordable Infrared-Optical Pose Tracking   (“iotracker”)
T. Pintaric — January 2005 to December 2010 • Keywords: Augmented Reality, Virtual Reality, 6-DoF Tracking, Realtime
iotracker is a new low-cost infrared-optical pose-tracking system for room-sized virtual environments. The system consists of 4-8…

Studierstube - A Collaborative Augmented Reality System Studierstube - A Collaborative Augmented Reality System
D. Schmalstieg — January 1996 to December 2009 • Keywords: Studierstube, Augmented Reality, Distributed Systems, User Interfaces
Studierstube is the study room where Goethe's famous character, Faust, tries to acquire knowledge and enlightenment. We chose this term as the…

Development of an Augmented-Reality Dynamic Spatial Test Development of an Augmented-Reality Dynamic Spatial Test   (“ARST”)
H. Kaufmann — November 2006 to October 2009 • Keywords: training, Spatial Abilities, Dynamic Testin, Augmented Reality, Item-Response-Models
In the proposed project we intend to develop a new type of test for the assessment of spatial abilities that differs from conventional spatial…

Construct3D - An Augmented Reality System for Mathematics and Geometry Education Construct3D - An Augmented Reality System for Mathematics and Geometry Education
H. Kaufmann — January 1999 to December 2008 • Keywords: Studierstube, Augmented Reality, Applications
Construct3D is a three dimensional geometric construction tool based on the collaborative augmented reality system "Studierstube". Our setup uses a…

Seminar: Virtual Reality Systems for Psychology Seminar: Virtual Reality Systems for Psychology   (“Joint Seminar”)
H. Kaufmann — September to November 2008 • Keywords: Virtual Reality, Spatial Abilities, Virtual Reality in Education, Virtual Reality in Therapy, Psychology
The aim of the bilateral seminar is to report ongoing work and projects, to exchange views and specify directions of future joint work. The focus of…

Development of Opitcal Tracking-System Development of Opitcal Tracking-System   (“Tracking-System”)
C. Breiteneder — January to December 2006 • Keywords: High speed cameras, Infrared Optical Tracking, Computer vision software
In this project we develop and improve an infrared-optical tracking system and the according tracking software in order to track multiple targets in…

Geometrie content with Construct3D Geometrie content with Construct3D   (“Construct3D-Lernmodule”)
C. Breiteneder — December 2005 to August 2006 • Keywords: Virtual Reality, Augmented Reality, Construct 3D, Geometry
Erstellung von Geometrieinhalten für den Unterricht in Darstellender Geometrie in Virtual Reality mit Construct 3D

Educating Spatial Intelligence in Augmented Reality Educating Spatial Intelligence in Augmented Reality   (“Spatial Abilities”)
H. Kaufmann, C. Breiteneder — January 2003 to December 2005 • Keywords: Spatial Abilities, Augmented Reality, Studierstube, Construct3D
Spatial abilities present an important component of human intelligence. Many studies have shown that spatial abilities can be improved by…

Mobile Collaborative Augmented Reality Mobile Collaborative Augmented Reality   (“MCAR”)
D. Schmalstieg — January 2000 to December 2003 • Keywords: Studierstube, Augmented Reality, Distributed Systems, Mobile Computing
Mobile computing is naturally complemented by Augmented Reality (AR), which superimposes computer-generated images onto a user's perception of the…

Lab Projects

Vienna Virtual Reality Framework for Unreal Vienna Virtual Reality Framework for Unreal   (“V2RFUn”)
H. Kaufmann — November 2017 to October 2022
Development of a framework with flexible tracking options, device integration, robot and avatar interaction and much more for VR applications in…

Robot Supported Virtual and Augmented Reality Robot Supported Virtual and Augmented Reality   (“RobotVR”)
E. Vonach — October 2013 to June 2020 • Keywords: Immersive Virtual Reality, Encounter-type haptics, Prop-based haptic feedback, Robotics
The issue of inadequate haptic feedback in VR/AR setups is an open problem. Haptic or tactile gloves as well as force-feedback devices approach the…

Learn VR: Introduction to Virtual and Augmented Reality Learn VR: Introduction to Virtual and Augmented Reality   (“VR course”)
H. Kaufmann — June 2016 to December 2019 • Keywords: Teaching, Immersive Virtual Reality, Augmented Reality
Creating high quality virtual reality (VR) experience takes time and requires extensive practice. Although, multiple virtual and augmented reality…

Bridges in VR Bridges in VR   (“VR Bridges”)
K. Vasylevska — January to August 2019
Virtual Reality group from TU Wien is looking for study participants!

Immersive Interaction in Streamed Dense 3D Surface Reconstructions Immersive Interaction in Streamed Dense 3D Surface Reconstructions   (“ImmersivePointClouds”)
A. Mossel — March 2015 to July 2018 • Keywords: Virtual Reality, Immersive, Selection, Navigation, Dense 3D Surface Reconstructions, Point Clouds, Perception, Occlusion Management
Within the project, we investigate novel methods to understand and interact with large dense 3D surface reconstructions while being immersive within…

ImmersiveDeck: A large-scale wireless VR system for multiple users ImmersiveDeck: A large-scale wireless VR system for multiple users
H. Kaufmann — January 2015 to August 2017
We present a low-cost multi-user immersive Virtual Reality system that enables collaborative experiences in large virtual environments. In the…

Stereo video see-through head mounted display Stereo video see-through head mounted display   (“SteVSees”)
C. Schönauer — September 2014 to March 2017 • Keywords: Stereo, video see-through, head mounted display, stereo camera
Für stereoskopische Augmented Reality Anwendungen benötigt man ein see-through Headset/Head Mounted Display. Die reale Welt sieht man dabei entweder…

Assessing the Sensory Functionality of Children with Autism Spectrum Disorder Assessing the Sensory Functionality of Children with Autism Spectrum Disorder   (“Autism”)
C. Schönauer — June 2013 to February 2017 • Keywords: Autism, Motion Tracking, Sensors, Depth Sensor
The causes and mechanisms of Autism Spectrum Disorder (ASD) are not yet fully understood. One line of research that should translate into more…

Virtual Reality Menu Interaction with a Smartwatch Virtual Reality Menu Interaction with a Smartwatch   (“Smartwatch”)
I. Podkosova — December 2015 to September 2016 • Keywords: Vitual Reality, VR Menus, Smartwatch
In immersive virtual environments users are placed inside virtual reality simulations. In such systems, menus are needed to change the system state,…

SmartCopter - Autonomous Flight with a Smartphone as On-Board Processing Unit SmartCopter - Autonomous Flight with a Smartphone as On-Board Processing Unit
A. Mossel — January 2012 to December 2015 • Keywords: Unmanned Aerial Vehicles, Autnonomous Localization, Mixed Reality, Autonomous Flight
This project combines a number of research activities to design and develop UAVs based on off the shelf hardware. The major goals of our research…

The Virtualizer - A New Locomotion Device The Virtualizer - A New Locomotion Device   (“Virtualizer”)
H. Kaufmann — May 2013 to December 2015 • Keywords: Locomotion Device, Virtualizer, Cyberith
The Virtualizer is a locomotion device with integrated sensors for motion detection. With this device you can move, run, jump, crouch, strafe in your…

Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback   (“Motion Guidance”)
C. Schönauer — November 2011 to December 2015
The ability to guide human motion through automatically generated feedback has significant potential for applications in areas, such as motor…

Wide Area Indoor Tracking Wide Area Indoor Tracking   (“WideTracker”)
A. Mossel — January 2013 to August 2015 • Keywords: Wide Area Tracking, Real-Time Optical Tracking, Indoor, Unconstrained Environments, Harsh Environments
In this project, a real-time tracking system is developed that tracks multiple active infrared targets in real-time within large volumes. A minimum…

MediCubes: Design of a Health Monitoring Toy for Children MediCubes: Design of a Health Monitoring Toy for Children
E. Vonach — December 2013 to February 2015 • Keywords: Health monitoring, home monitoring, pervasive healthcare, storytelling toy, children, Tangible User Interface, sensors.
Especially for children monitoring their health can result in a stressful situation, even when conducted at home by their parents. Current advances…

ARTiFICe - Augmented Reality Framework for Distributed Collaboration ARTiFICe - Augmented Reality Framework for Distributed Collaboration
A. Mossel — January 2011 to December 2014 • Keywords: Virtual Reality Framework, 3D Interaction Techniques, Collaboration, Mobile Augmented Reality, Mobile Interaction, Low-cost Tracking Devices
This project aims on developing a flexible and powerful VR/AR framework build around on an off the shelf game engine (Unity3D). It offers rapid…

Natural User Interfaces for Mobile Mixed Reality Natural User Interfaces for Mobile Mixed Reality   (“Mobile Interaction”)
A. Mossel — January 2012 to December 2014 • Keywords: Handheld Mixed Reality, 3D Interaction, Human Computer Interface, Natural User Interface, Interaction Methaphors, Gesture Recognition
This project combines a number of research activities to create intuitive ways to interact with 3D content in a mobile mixed reality environment. Our…

OpenTracker v2.0 - An Open Software Framework for Virtual Reality Input OpenTracker v2.0 - An Open Software Framework for Virtual Reality Input   (“OpenTracker2”)
H. Kaufmann — January 2011 to August 2014 • Keywords: Virtual Reality, Augmented Reality, Tracking, 3D Interaction, ARTiFICe
OpenTracker was originally developed in 2002/2003 @ IMS (see OpenTracker project page @ TU Graz) to be generic solution to the different tasks…

MoveOnPC - Supporting the PlayStation Move controller on the PC MoveOnPC - Supporting the PlayStation Move controller on the PC
H. Kaufmann — November 2010 to December 2013 • Keywords: Playstation Move Controller, 3D Input, OpenCV, Sensor Fusion
In October/September 2010 Sony released the PlayStation Move – a motion-sensing game controller for the PlayStation 3. The Move controller is an…

Vertical Navigation Methaphors: Virtual Elevator Vertical Navigation Methaphors: Virtual Elevator   (“Virtual Elevator”)
K. Vasylevska — April to September 2013 • Keywords: Virtual Reality, Redirected Walking, Spatial Presence, Haptic Feedback, Visual Realism
A sense of spatial presence as a feeling of “being there” is an important part of the virtual experience. Navigation is a fundamental task in virtual…

iOrb - Unifying Command and 3D Input for Mobile Augmented Reality iOrb - Unifying Command and 3D Input for Mobile Augmented Reality
G. Reitmayr — January 2004 to December 2005 • Keywords: Studierstube, Mobile Computing, Augmented Reality
Input for mobile augmented reality systems is notoriously difficult. Three dimensional visualization would be ideally accompanied with 3D…

The Invisible Train: A Handheld Augmented Reality Game The Invisible Train: A Handheld Augmented Reality Game   (“Invisible Train”)
T. Pintaric — January 2004 to December 2005 • Keywords: Augmented Reality, Mobile Devices, Wearable Devices, PDA, Games
The Invisible Train is the first real multi-user Augmented Reality application for handheld devices (PDAs). Unlike other projects, in which wearable…

OpenTracker - An Open Software Framework for Virtual Reality Input OpenTracker - An Open Software Framework for Virtual Reality Input
H. Kaufmann — January 2001 to December 2004 • Keywords: Studierstube, Augmented Reality, Tracking, Distributed Systems
OpenTracker is developed to be generic solution to the different tasks involved in tracking input devices and processing tracking data for virtual…

Augmented Presentation and Interaction Language Augmented Presentation and Interaction Language   (“APRIL”)
F. Ledermann — January 2002 to December 2003 • Keywords: Studierstube
An XML language for authoring content of story-based augmented reality presentations.

Outdoor Collaborative Augmented Reality Outdoor Collaborative Augmented Reality   (“OCAR”)
G. Reitmayr — January to December 2003 • Keywords: Studierstube, Augmented Reality, Mobile Computing, GPS
The aim of this project is to investigate how two or more users can interact on such tasks as navigation and information browsing/display with the…

Pivy Pivy
T. Fahmy — January 2002 to December 2003 • Keywords: Studierstube
Pivy allows you to write Open Inventor applications in Python. It will be possible to interactively edit Open Inventor programs from within the…

Signpost Signpost
D. Schmalstieg — January 2001 to December 2003 • Keywords: Studierstube, Augmented Reality, Tracking, Mobile Computing, Applications
SignPost is an augmented reality application that is able to guide a person through an unfamiliar building.

Studierstube Render Array Studierstube Render Array   (“Stuberena”)
D. Schmalstieg — January to December 2003 • Keywords: Studierstube
The Studierstube Render Array creates a seamless tiled display using multiple overlapping projectors and a cluster of PCs.

Virtual Showcase Virtual Showcase
F. Ledermann — January 2001 to December 2003 • Keywords: Studierstube, Augmented Reality, Visualization
The project aims at developing the knowledge and technology for Virtual Showcases to become standard equipment for museums and other public…