ATTENTION: This is a web archive! The IMS Group was split up in 2018 and does not exist anymore. Recent work of former members can be found at the VR/AR Group and the Computer Vision Group.

Interactive Media Systems, TU Wien

Image and Video Analysis & Synthesis

Contact: Margrit Gelautz

Our group performs basic and applied research on image and video analysis & synthesis with a focus on 3D scene reconstruction (especially, stereo analysis), video object segmentation, image matting and motion estimation. Current research activities concentrate on the application fields of assisted/autonomous driving and motion studies for human-robot interaction.

Completed

Research Projects

Doctoral College TrustRobots Doctoral College TrustRobots   (“TrustRobots”)
M. Gelautz — September 2018 to August 2021 • Keywords: robotcs, computer vision, human motion, motion capture, embodiment
The main objectives of this DC are (i) to analyse the phenomenon of trust in robots in a transdisciplinary research project from different…

Advanced Vision-Based Sensing for Aerial Vehicles Advanced Vision-Based Sensing for Aerial Vehicles   (“AVIS”)
M. Gelautz — April 2015 to December 2020
The small, low-cost design and easy handling of advanced unmanned aerial vehicles (UAV - unmanned air vehicle) rapidly foster their further…

Combined 3D-Vision and Adaptive Front-Lighting System for Safe Autonomous Driving Combined 3D-Vision and Adaptive Front-Lighting System for Safe Autonomous Driving   (“CarVisionLight”)
M. Gelautz — September 2017 to December 2020
Driven by the trend towards highly automated or even autonomous driving, the automotive industry currently undergoes dramatic changes. The evolution…

Innovative production workflow for precise 3D scene reconstruction Innovative production workflow for precise 3D scene reconstruction   (“Precise3D”)
M. Gelautz — August 2016 to December 2019
The goal of the project is the development of a scalable and cost-efficient workflow for the accurate 3D scanning of film sets and the creation of…

Intelligent Assistant System for Video Production on Mobile Devices Intelligent Assistant System for Video Production on Mobile Devices   (“PersonalFilmAssistant”)
M. Gelautz — August 2016 to September 2019
Modern mobile devices such as smartphones enable even the most novice user to easily take high quality pictures. Along with technological advances in…

KOROS – Collaborating Robot Systems KOROS – Collaborating Robot Systems
M. Gelautz — January 2012 to December 2017 • Keywords: Robotics
Our institute is a member of TU Vienna's KOROS network - an interdisciplinary collaboration between different departments for joint research in the…

Intelligent Workflow Design for Low-Cost 3D Film Production Intelligent Workflow Design for Low-Cost 3D Film Production   (“Hyperion3D”)
M. Gelautz — June 2013 to December 2016 • Keywords: Computer Vision, 3D film, Stereo
Goal of Hyperion3D is the development of an intelligent and cost-efficient workflow for producing 3D film content for stereoscopic and multi-view 3D…

3D content creation, coding and transmission over future media networks 3D content creation, coding and transmission over future media networks   (“3D-ConTourNet”)
M. Gelautz — October 2014 to September 2016 • Keywords: 3D Media Network Protocols, 3D Media Coding, 3D Multimedia Services, 3D Quality of Experience, 3D Multimedia Transmission
3D-ConTourNet is a COST Action which undertakes coordinated research collaboration, at European level, in 3D multimedia creation, encoding, delivery…

HDRi: The digital capture, storage, transmission and display of real-world lighting HDRi: The digital capture, storage, transmission and display of real-world lighting
M. Gelautz — May 2011 to December 2015 • Keywords: Human perception, Image Processing, High Dynamic Range, imaging
The natural world presents our eyes with a wide range of colours and intensities from moonlight to bright sunshine. We can see detail in regions that…

Robust Real-Time Depth Measurement Using Structured Light Robust Real-Time Depth Measurement Using Structured Light   (“Robust Depth 3D”)
M. Gelautz — November 2014 to December 2015 • Keywords: structured light, depth measurement
The project "Robust Real-Time Depth Measurement Using Structured Light" explores the current state of the art in Depth Measurement using Structured…

Temporal-Consistent Stereo Matting for High-Quality Novel View Synthesis and Visual Effects Temporal-Consistent Stereo Matting for High-Quality Novel View Synthesis and Visual Effects   (“3D-TV”)
M. Gelautz — April 2009 to December 2015 • Keywords: video processing, stereo analysis, 3D reconstruction, special effects, image matting
This project develops new image processing techniques for the emerging field of 3D television. On the basis of two videos that are recorded by…

Video Engine Design Methodology Rules Video Engine Design Methodology Rules   (“VENDOR”)
M. Gelautz — August 2006 to September 2015 • Keywords: video coding, video processing
The rapid increase in integration density on chips sets leads to an increasin amount of complex applications. In modern SoC (System on Chip) designs,…

An industrial implementation of modern inpainting techniques for depth-based 3D film editing An industrial implementation of modern inpainting techniques for depth-based 3D film editing   (“PAINT3D”)
M. Gelautz — January 2012 to December 2014 • Keywords: Inpainting, Novel Views, 3D film
The goal of this project is the implementation of a software prototype which enables the adaption of depth perception in 3D films in unprecedented…

High-quality 3D Video by Fusing Active and Passive Sensors High-quality 3D Video by Fusing Active and Passive Sensors   (“3D VideoFusion”)
M. Gelautz — June 2012 to November 2014 • Keywords: 3D video, stereo analysis, Active (TOF, Kinect) sensor, 3D scene reconstruction, sensor fusion, image and video matting
The aim of this project is to develop new technologies for creating high-quality 3D video materials by combining active and passive 3D sensors. The…

3D Scene Completion 3D Scene Completion   (“Complete3D”)
M. Gelautz — October 2011 to October 2014 • Keywords: 3D scene reconstruction, scene geometry, novel view synthesis, 3D scene analysis
Creating 2D or 3D views from a finite set of input images has been a long-standing goal in Computer Vision - this project revisits this fundamental…

Computational Perception Computational Perception   (“CP”)
M. Gelautz — March 2010 to February 2014 • Keywords: Multimodal Scene Perception, Visual Attention and Human Behavior, Object recognition
The perception, interpretation and presentation of our environment using sensors and computer technology, in combination with related communication…

Changes Changes
M. Gelautz — October 2010 to September 2012
The Changes program supports female researchers working on application-oriented research projects that are carried out in collaboration between TU…

Evaluation and Design of Energy Functions for Global Stereo Matching Evaluation and Design of Energy Functions for Global Stereo Matching   (“Stereo Matching”)
M. Gelautz — January 2007 to December 2011 • Keywords: Stereo, 3D Reconstruction, Computer Vision, Scene Modeling, Energy Function, Optimization
This project investigates and improves the modelling component of energy minimization techniques for stereo matching. One major contribution is a…

Evaluation of Methods for Generating Virtual Views for 3D Film Material Evaluation of Methods for Generating Virtual Views for 3D Film Material   (“Eva3D”)
M. Gelautz — February to December 2011 • Keywords: 3D cinema, 3D video, Stereo, Virtual views
We evaluate a method for generating virtual views derived from stereoscopic film material regarding the visual quality (e.g. image artifacts) and…

Evaluation of Methods for Live-Webcam-Videoconferencing Evaluation of Methods for Live-Webcam-Videoconferencing   (“EvaWeb”)
M. Gelautz — August to December 2011 • Keywords: evaluation, webcam, video conference
Technical evaluation on live webcam videoconferencing systems

Alpha Matting from Single and Multiple Images Alpha Matting from Single and Multiple Images   (“ALPHAMAT”)
M. Gelautz — January 2006 to December 2009 • Keywords: Matting
This project aims to make a step forward in image matting, by developing novel algorithms and user interaction techniques that meet the requirements…

3D Video Analysis for Interactive Multimedia Applications 3D Video Analysis for Interactive Multimedia Applications   (“Video3D”)
M. Gelautz — October 2002 to January 2006
In our project, we concentrate on video processing tasks that arise in the context of interactive multimedia applications. In particular, we…

Image and Video Analysis for Artistic Rendering (VideoArt) Image and Video Analysis for Artistic Rendering (VideoArt)   (“VideoArt”)
M. Gelautz — January to December 2004 • Keywords: Image Processing, Video Analysis, Art, Painting, Non-photorealistic Rendering (NPR), Computer Graphics, Visualization
The Hochschuljubiläumsstiftung der Stadt Wien granted a project entitled "Bild- und Videoverarbeitung zur Erzeugung künstlerischer Effekte", which…