Interactive Media Systems, TU Vienna

Media Processing

Contact: Horst Eidenberger

Our ultimate media processing goal is human-like understanding of multimedia content. We extract semantically relevant patterns from audio, biosignals, images, text, video and other data types and set them into context by intelligent categorization.

Research Projects

Unusual sequences detection in very large video collections Unusual sequences detection in very large video collections   (“FAMOUS”)
M. Zaharieva — Since October 2012 • Keywords: video data mining, Outlier detection, Media analysis, unusual sequence detection
Large media repositories are often facing large additions of new material with no prior knowledge about the content. The screening, assessment, and…

Lab Projects

Semantic Multimodal TU Information System Semantic Multimodal TU Information System   (“mplTIS2”)
H. Eidenberger — Since December 2015
Enhance the existing TU Wien information system TISS by semantic and multimodal components, including but not limited to, semantic search over all…

TU Fly Into the Future TU Fly Into the Future   (“mplTUFly”)
H. Eidenberger — Since April 2015 • Keywords: Virtual Reality, Immersion, Virtual Flying, Immersive Virtual Reality, Virtual Space Walk, Virtual Diving
The focus of this project is real flying through virtual worlds, where the applications are not just bird flight, but as well diving along virtual…

Biosignal Understanding Biosignal Understanding   (“mplBiosignal”)
H. Eidenberger — Since January 2004 • Keywords: Brain Computer Interface, EEG, EMG, Noise Mesurement
Biosignal processing activities in the IMS group range from mental cursor control over various applications for the brain computer interface to the…

Text Understanding Text Understanding   (“mplText”)
H. Eidenberger — Since January 2004 • Keywords: Text Retrieval, Autmated Translation, Natural Language Processing
Text is a traditional source for information retrieval applications. At the IMS we develop solutions for selected (domain-specific) text…

Multimedia Gaming Multimedia Gaming   (“mplGaming”)
H. Eidenberger — Since January 2003 • Keywords: Gaming Apps, Strategy Gaming, Media Games for Children, Multimedia Storytelling
Multimedia and gaming are two areas as closely linked in science as in practical application. The IMS has always endeavored to provide multimedia in…

Forensic Media Analysis Forensic Media Analysis   (“mplForensic”)
H. Eidenberger — Since January 2002 • Keywords: Biometric Face Analysis, Voice Identification, Forensic Video Recording, Limits of Biometric Recognition
The media processing group of the IMS is highly active in the application and further development of solutions for forensic audio and video analysis.…

Media Authoring and Production Media Authoring and Production   (“mplAuthoring”)
H. Eidenberger — Since January 2002 • Keywords: Mobile Apps, Media Storage, Media Applications, Media Production
In this project, we endeavor to frame media content with application design, thus giving interactivity to the per se passive content. Typical…

Audio Analysis and Authoring Audio Analysis and Authoring   (“mplAudio”)
H. Eidenberger — Since July 2000 • Keywords: Audio Retrieval, Speech Processing, Sound Recognition, Music Analysis
The audio analysis and authoring project comprises all our efforts in the area of audio signal processing and categorization. Projects range from…

Media Programming and Transport Media Programming and Transport   (“mplProgramming”)
H. Eidenberger — Since July 2000 • Keywords: Mobile Media Programming, Sensor Control, Evaluation Databases, Programming Environments, Streaming
The media processing team of the IMS group has collected expertise in the area of media programming and transport for almost two decades. Programming…

Geographical Media Systems Geographical Media Systems   (“mplGeomedia”)
H. Eidenberger — Since January 2000 • Keywords: Location-Based Services, Gemedia Referencing, Map-Based Sonfication
The Geomedia project summarizes our efforts in the area of location-based media presentation, summarization and referencing. Tasks range from classic…

Machine Learning for Multimedia Understanding Machine Learning for Multimedia Understanding   (“mplLearning”)
H. Eidenberger — Since January 1998 • Keywords: Limits of Categorization, Psychophysics, Similarity Modeling, Kernel-Based Learning
The machine learning activities of the media processing group derive from the necessity to classify media objects described by signal processing in…

Visual Media Analysis Visual Media Analysis   (“mplVisual”)
H. Eidenberger — Since January 1998 • Keywords: Video Summrization, Scene Classification, Visual Retrieval, Image Understanding, Big Media Data
Visual media analysis is the central activity of the media processing subgroup at the IMS. Expertise has been gained since the mid 1990ies. Today,…

Completed

Research Projects

MobiGuide: Guiding Patients Anytime Everywhere MobiGuide: Guiding Patients Anytime Everywhere
Silvia Miksch — November 2011 to October 2015 • Keywords: Personalized Medicine, Information Visualization, Personal Health Record, Monitoring Devices, Visual Analytics, clinical Decision-Support Systems, Computer-Interpretable Guidelines, Body Area Networks
MobiGuide (MG) will develop a patient guidance system that integrates hospital and monitoring data into a Personal Health Record (PHR) accessible by…

Support for Authoring and Transformation of Clinical Guidelines and Protocols Support for Authoring and Transformation of Clinical Guidelines and Protocols   (“Brigid”)
K. Kaiser — November 2010 to October 2015 • Keywords: Clinical Practice Guidelines, Information Extraction, Knowledge Modelling
Clinical guidelines and protocols (CGPs) are promising means to improve the quality of health care. Supporting their application by computer systems…

Automatic Analysis of Elephant Vocalizations Automatic Analysis of Elephant Vocalizations   (“Elevoc”)
C. Breiteneder — February 2011 to January 2015 • Keywords: Multimodal content-based analysis, automatic monitoring, bioacoustics, vocal communication, elephants
The decline of habitat for elephants as a result of expanding human activity combined with increasing elephant numbers in spatially separated…

Intelligent Video Annotation and Retrieval Techniques Intelligent Video Annotation and Retrieval Techniques   (“IV-ART”)
H. Eidenberger — September 2009 to August 2012 • Keywords: Video Annotation, Video Retrieval, Image Descriptor
Although content based image and video analysis have been used successfully to solve a set of real world tasks in recent years, approaches to employ…

Digital Formalism - The Vienna Vertov Collection Digital Formalism - The Vienna Vertov Collection
C. Breiteneder — February 2007 to July 2010 • Keywords: video analysis, formalism, Dziga Vertov
Digital Formalism: The Vienna Vertov Collection focuses on the computer-aided digital analysis of the senses of cinema. On the foundation of…

Information Extraction from Evidence-Based Guidelines Information Extraction from Evidence-Based Guidelines   (“EviX”)
Silvia Miksch — January 2006 to November 2009 • Keywords: Information Extraction, Clinical Guidelines and Protocols, Evidence-Based Medicine
The goal of the proposed project is the experimental application and further development of promising approaches in the area of semi-automatic…

VizIR - A Framework for Visual Information Retrieval VizIR - A Framework for Visual Information Retrieval
H. Eidenberger — March 2003 to February 2006 • Keywords: Visual Information Retrieval
The project VizIR - A Framework for Visual Information Retrieval, submitted by the Institute of Software Technology and Interactive Systems at the…

Lab Projects

TU Jump Into The Future TU Jump Into The Future   (“VirtualJumpSimulator”)
H. Eidenberger — September 2014 to April 2015 • Keywords: Virtual Reality, Immersion, Virtual Parachute Jump, Immersive Virtual Reality, 3D City Model
Within the project "TU Jump Into The Future", a Virtual Jump Simulator (VJS) was developed that allows users to perform a virtual parachute jump over…