Interactive Media Systems, TU Vienna

Image and Video Analysis & Synthesis

Contact: Margrit Gelautz

Our group performs basic and applied research on image and video analysis & synthesis with a strong focus on stereo processing, image matting, high dynamic range imaging, and related visualization techniques. Our work on 3D scene reconstruction is particularly motivated by the latest developments in the field of 3D movie/TV.

Research Projects

Advanced Vision-Based Sensing for Aerial Vehicles Advanced Vision-Based Sensing for Aerial Vehicles   (“AVIS”)
M. Gelautz — Since April 2015
The small, low-cost design and easy handling of advanced unmanned aerial vehicles (UAV - unmanned air vehicle) rapidly foster their further…

Intelligent Workflow Design for Low-Cost 3D Film Production Intelligent Workflow Design for Low-Cost 3D Film Production   (“Hyperion3D”)
M. Gelautz — Since June 2013 • Keywords: 3D film, Stereo, Computer Vision
Goal of Hyperion3D is the development of an intelligent and cost-efficient workflow for producing 3D film content for stereoscopic and multi-view 3D…

KOROS – Collaborating Robot Systems KOROS – Collaborating Robot Systems
M. Gelautz — Since January 2012 • Keywords: Robotics
Our institute is a member of TU Vienna's KOROS network - an interdisciplinary collaboration between different departments for joint research in the…

Completed

Research Projects

3D content creation, coding and transmission over future media networks 3D content creation, coding and transmission over future media networks   (“3D-ConTourNet”)
M. Gelautz — October 2014 to September 2016 • Keywords: 3D Media Network Protocols, 3D Media Coding, 3D Multimedia Services, 3D Quality of Experience, 3D Multimedia Transmission
3D-ConTourNet is a COST Action which undertakes coordinated research collaboration, at European level, in 3D multimedia creation, encoding, delivery…

HDRi: The digital capture, storage, transmission and display of real-world lighting HDRi: The digital capture, storage, transmission and display of real-world lighting
M. Gelautz — May 2011 to December 2015 • Keywords: High Dynamic Range, imaging, Human perception, Image Processing
The natural world presents our eyes with a wide range of colours and intensities from moonlight to bright sunshine. We can see detail in regions that…

Robust Real-Time Depth Measurement Using Structured Light Robust Real-Time Depth Measurement Using Structured Light   (“Robust Depth 3D”)
M. Gelautz — November 2014 to December 2015 • Keywords: structured light, depth measurement
The project "Robust Real-Time Depth Measurement Using Structured Light" explores the current state of the art in Depth Measurement using Structured…

Temporal-Consistent Stereo Matting for High-Quality Novel View Synthesis and Visual Effects Temporal-Consistent Stereo Matting for High-Quality Novel View Synthesis and Visual Effects   (“3D-TV”)
M. Gelautz — April 2009 to December 2015 • Keywords: image matting, special effects, 3D reconstruction, video processing, stereo analysis
This project develops new image processing techniques for the emerging field of 3D television. On the basis of two videos that are recorded by…

Video Engine Design Methodology Rules Video Engine Design Methodology Rules   (“VENDOR”)
M. Gelautz — August 2006 to September 2015 • Keywords: video coding, video processing
The rapid increase in integration density on chips sets leads to an increasin amount of complex applications. In modern SoC (System on Chip) designs,…

An industrial implementation of modern inpainting techniques for depth-based 3D film editing An industrial implementation of modern inpainting techniques for depth-based 3D film editing   (“PAINT3D”)
M. Gelautz — January 2012 to December 2014 • Keywords: 3D film, Novel Views, Inpainting
The goal of this project is the implementation of a software prototype which enables the adaption of depth perception in 3D films in unprecedented…

High-quality 3D Video by Fusing Active and Passive Sensors High-quality 3D Video by Fusing Active and Passive Sensors   (“3D VideoFusion”)
M. Gelautz — June 2012 to November 2014 • Keywords: 3D video, stereo analysis, Active (TOF, Kinect) sensor, 3D scene reconstruction, sensor fusion, image and video matting
The aim of this project is to develop new technologies for creating high-quality 3D video materials by combining active and passive 3D sensors. The…

3D Scene Completion 3D Scene Completion   (“Complete3D”)
M. Gelautz — October 2011 to October 2014 • Keywords: 3D scene reconstruction, scene geometry, novel view synthesis, 3D scene analysis
Creating 2D or 3D views from a finite set of input images has been a long-standing goal in Computer Vision - this project revisits this fundamental…

Computational Perception Computational Perception   (“CP”)
M. Gelautz — March 2010 to February 2014 • Keywords: Multimodal Scene Perception, Visual Attention and Human Behavior, Object recognition
The perception, interpretation and presentation of our environment using sensors and computer technology, in combination with related communication…

Changes Changes
M. Gelautz — October 2010 to September 2012
The Changes program supports female researchers working on application-oriented research projects that are carried out in collaboration between TU…

Evaluation and Design of Energy Functions for Global Stereo Matching Evaluation and Design of Energy Functions for Global Stereo Matching   (“Stereo Matching”)
M. Gelautz — January 2007 to December 2011 • Keywords: Stereo, 3D Reconstruction, Computer Vision, Scene Modeling, Energy Function, Optimization
This project investigates and improves the modelling component of energy minimization techniques for stereo matching. One major contribution is a…

Evaluation of Methods for Generating Virtual Views for 3D Film Material Evaluation of Methods for Generating Virtual Views for 3D Film Material   (“Eva3D”)
M. Gelautz — February to December 2011 • Keywords: 3D cinema, Stereo, 3D video, Virtual views
We evaluate a method for generating virtual views derived from stereoscopic film material regarding the visual quality (e.g. image artifacts) and…

Evaluation of Methods for Live-Webcam-Videoconferencing Evaluation of Methods for Live-Webcam-Videoconferencing   (“EvaWeb”)
M. Gelautz — August to December 2011 • Keywords: webcam, evaluation, video conference
Technical evaluation on live webcam videoconferencing systems

Alpha Matting from Single and Multiple Images Alpha Matting from Single and Multiple Images   (“ALPHAMAT”)
M. Gelautz — January 2006 to December 2009 • Keywords: Matting
This project aims to make a step forward in image matting, by developing novel algorithms and user interaction techniques that meet the requirements…

3D Video Analysis for Interactive Multimedia Applications 3D Video Analysis for Interactive Multimedia Applications   (“Video3D”)
M. Gelautz — October 2002 to January 2006
In our project, we concentrate on video processing tasks that arise in the context of interactive multimedia applications. In particular, we…

Image and Video Analysis for Artistic Rendering (VideoArt) Image and Video Analysis for Artistic Rendering (VideoArt)   (“VideoArt”)
M. Gelautz — January to December 2004 • Keywords: Image Processing, Video Analysis, Art, Painting, Non-photorealistic Rendering (NPR), Computer Graphics, Visualization
The Hochschuljubiläumsstiftung der Stadt Wien granted a project entitled "Bild- und Videoverarbeitung zur Erzeugung künstlerischer Effekte", which…