Interactive Media Systems, TU Wien

Virtual Reality Training for Upper Limb Prosthesis Patients

Research project in the area of Virtual and Augmented Reality.

Keywords: Virtual Reality, Virtual Rehabilitation, Serious Gaming, 6DOF Interaction, Bio Sensor, ARTiFICe, iotracker.

About this Project

The initial fitting of an upper limb prosthesis can be a frustrating experience for amputees, impairing the learning of prosthesis control. Therefore, the prosthesis manufacturer Otto Bock in collaboration with Vienna University of Technology developed a Virtual Reality environment in which tasks can be trained in order to continuously motivate the amputees to practice their control skills without taking risks. iotracker optical motion capture system, developed by Vienna UT, is used to track the amputee's arm and head movement to allow for 3D input and correct visualization of the virtual environment in a head mounted display. Along with the tracking data, electromyography is used to generate input for grasping control of the virtual prosthesis, creating a realistic simulation. Tracking data of iotracker and electromyography is fed into ARTiFICE, an Augmented Reality Framework for Distributed Collaboration. ARTiFICe maps the tracking data to the virtual objects, using Unity3D game engine for networking, real time rendering and object’s physical behaviour.

Project Partners

Otto Bock HealthCare


Framework Overview

Supported Training Scenarios



System overview


Selected for 2012 Best Unity Serious Gaming Projects (