Semi-automatic post-processing of multi-view 2D-plus-depth video

By Braulio Sespede, Florian Seitner, and Margrit Gelautz

Abstract

We propose a post-processing framework based on multiview interactive video segmentation for correcting 2D-plus-depth video footage. The suggested approach uses user-made scribbles to guide the multi-view segmentation process, which is based on an efficient cost-volume filtering algorithm. We extend the 2D algorithm to 3D and propose several improvements that increase precision and recall while also decreasing the need for user input. Our semi-automatic approach is supported by an interactive visualization tool that integrates both 2D and 3D views of the footage, allowing the user to explore novel views coherently and grasp a better understanding of the underlying data. We integrate our post-processing framework into a workflow for generating dynamic meshes from footage recorded by multiple stereo cameras, demonstrating the applicability of the technique.

Reference

B. Sespede, F. Seitner, M. Gelautz: "Semi-automatic post-processing of multi-view 2D-plus-depth video"; Poster: IS&T International Symposium on Electronic Imaging - Stereoscopic Displays and Applications, Burlingame, USA; 01-26-2019 - 01-30-2019; in: "IS&T International Symposium on Electronic Imaging", (2019), 5 pages.

BibTeX

@inproceedings{TUW-280564,     author = {Sespede, Braulio and Seitner, Florian and Gelautz, Margrit},     title = {Semi-automatic post-processing of multi-view 2D-plus-depth video},     booktitle = {IS{\&}T International Symposium on Electronic Imaging},     year = {2019},     numpages = {5},     url = {https://publik.tuwien.ac.at/files/publik_280564.pdf},     note = {poster presentation: IS{\&}T International Symposium on Electronic Imaging - Stereoscopic Displays and Applications, Burlingame, USA; 2019-01-26 -- 2019-01-30} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.