Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering
By Asmaa Hosni, Christoph Rhemann, Michael Bleyer, and Margrit Gelautz
Abstract
This paper presents a new efficient algorithm for computing temporally consistent disparity maps from video footage. Our method is motivated by recent work [1] that achieves high quality stereo results by smoothing disparity costs with a fast edge-preserving filter. This previous approach was designed to work with single static image pairs and does not maintain temporal coherency of disparity maps when applied to video streams. The main contribution of our work is to transfer this concept to the spatio-temporal domain in order to efficiently achieve temporally consistent disparity maps, where disparity changes are aligned with spatiotemporal edges of the video sequence. We further show that our method can be used as spatio-temporal regularizer for optical flow estimation. Our approach can be implemented efficiently, achieving real-time results for stereo matching. Quantitative and qualitative results demonstrate that our approach (i) considerably improves over frame-by-frame methods for both stereo and optical flow; and (ii) outperforms the state-of-the-art for local space-time stereo approaches.
Reference
A. Hosni, C. Rhemann, M. Bleyer, M. Gelautz: "Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering"; Talk: The Fifth Pacific-Rim Symposium on Image and Video Technology, Gwangju, South Korea; 11-20-2011 - 11-23-2011; in: "Advances in Image and Video Technology", Springer Verlag, (2011), ISBN: 978-3-642-25345-4; 165 - 177.
Downloads
| Demo | 24.1 MB | Windows Media video | Download |
BibTeX
Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.