AR Record & Replay: Situated Compositing of Video Content in Mobile Augmented Reality

By Tobias Langlotz, Mathäus Zingerle, Raphael Grasset, Hannes Kaufmann, and Gerhard Reitmayr

Abstract

In this paper we present a novel approach to record and replay video content composited in-situ with a live view of the real environment. Our real-time technique works on mobile phones, and uses an panorama-based tracker to create visually seamless and spatially registered overlay of video content. We apply a temporal foreground-background segmentation of video footage and show how the segmented information can be precisely registered in real-time in the camera view of a mobile phone. We describe the user interface and the video post effects implemented in our prototype as well as our approach with a skateboard training application. Our technique can also be used with online video material and supports the creation of augmented situated documentaries.

Reference

T. Langlotz, M. Zingerle, R. Grasset, H. Kaufmann, G. Reitmayr: "AR Record & Replay: Situated Compositing of Video Content in Mobile Augmented Reality"; in: "Proceedings of OzCHI (Australian Computer-Human Interaction Conference)", ACM Press, 2012, ISBN: 978-1-4503-1438-1, 318 - 326.

Video

 

Press Release

NewScientist (27 Oct 2012), PDF

BibTeX

@inproceedings{TUW-210334,     author = {Langlotz, Tobias and Zingerle, Math{\"a}us and Grasset, Raphael and Kaufmann, Hannes and Reitmayr, Gerhard},     title = {AR Record {\&} Replay: Situated Compositing of Video Content in Mobile Augmented Reality},     booktitle = {Proceedings of OzCHI (Australian Computer-Human Interaction Conference)},     year = {2012},     pages = {318--326},     publisher = {ACM Press},     url = {http://publik.tuwien.ac.at/files/PubDat_210334.pdf},     isbn = {978-1-4503-1438-1},     doi = {10.1145/2414536.2414588} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.