Interactive Media Systems, TU Wien

Evaluation of a 3D Reconstruction System Comprising Multiple Stereo Cameras

Thesis by Christian Kapeller

Supervision by Margrit Gelautz

Abstract

Recent advances in the fields of media production and mixed/virtual reality have generated an increasing demand for high-quality 3D models obtained from real scenes. A variety of 3D reconstruction methods including stereo vision techniques can be employed to compute the scene depth. Generally, the accuracy of stereo matching algorithms can be evaluated using well-established benchmarks with publicly available test data and reference solutions. As opposed to standard imaging configurations, the quality assessment of data delivered by customized 3D reconstruction systems may require the development of novel or adapted evaluation strategies tailored to the specific set-up. This work is concerned with evaluating the quality and accuracy of 3D models acquired with a 3D reconstruction system consisting of three stereo cameras. To this end, three different evaluation strategies are proposed and implemented. First, the 3D model accuracy is determined by acquiring reconstructions of geometrically simple validation objects (sphere, cuboid) that were specifically created for this purpose. Corresponding ideal 3D objects are fitted into the reconstructed point clouds and are compared to their real measurements. Second, an image-based novel view evaluation determines the accuracy of multiple reconstruction approaches on intermediate point clouds and final 3D mesh models. Finally, a pair comparison-based user study determines the subjective quality of different depth reconstruction approaches on acquired textured 3D mesh models. We demonstrate the three evaluation approaches on a set of self-recorded data. In this context, we also observe that the performance of the examined approaches varies only slightly in the novel view evaluation, while the user study results show clear preferences, which confirms the necessity to combine both quantitative and qualitative evaluation.

Reference

C. Kapeller: "Evaluation of a 3D Reconstruction System Comprising Multiple Stereo Cameras"; Supervisor: M. Gelautz; Fakultät für Informatik der Technischen Universität Wien, 2018.

BibTeX

Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.