Multiview stereo and silhouette consistency via convex functionals over convex domains
- PMID: 20820076
- DOI: 10.1109/TPAMI.2010.174
Multiview stereo and silhouette consistency via convex functionals over convex domains
Abstract
We propose a convex formulation for silhouette and stereo fusion in 3D reconstruction from multiple images. The key idea is to show that the reconstruction problem can be cast as one of minimizing a convex functional, where the exact silhouette consistency is imposed as convex constraints that restrict the domain of feasible functions. As a consequence, we can retain the original stereo-weighted surface area as a cost functional without heuristic modifications of this energy by balloon terms or other strategies, yet still obtain meaningful (non-empty) reconstructions which are guaranteed to be silhouette-consistent. We prove that the proposed convex relaxation approach provides solutions that lie within a bound of the optimal solution. Compared to existing alternatives, the proposed method does not depend on initialization and leads to a simpler and more robust numerical scheme for imposing silhouette consistency obtained by projection onto convex sets. We show that this projection can be solved exactly using an efficient algorithm. We propose a parallel implementation of the resulting convex optimization problem on a graphics card. Given a photo-consistency map and a set of image silhouettes, we are able to compute highly accurate and silhouette-consistent reconstructions for challenging real-world data sets. In particular, experimental results demonstrate that the proposed silhouette constraints help to preserve fine-scale details of the reconstructed shape. Computation times depend on the resolution of the input imagery and vary between a few seconds and a couple of minutes for all experiments in this paper.
Similar articles
-
Multiview stereo via volumetric Graph-Cuts and occlusion robust photo-consistency.IEEE Trans Pattern Anal Mach Intell. 2007 Dec;29(12):2241-6. doi: 10.1109/TPAMI.2007.70712. IEEE Trans Pattern Anal Mach Intell. 2007. PMID: 17934232
-
Fast joint estimation of silhouettes and dense 3D geometry from multiple images.IEEE Trans Pattern Anal Mach Intell. 2012 Mar;34(3):493-505. doi: 10.1109/TPAMI.2011.150. IEEE Trans Pattern Anal Mach Intell. 2012. PMID: 21808082
-
Local hull-based surface construction of volumetric data from silhouettes.IEEE Trans Image Process. 2008 Aug;17(8):1251-60. doi: 10.1109/TIP.2008.926149. IEEE Trans Image Process. 2008. PMID: 18632336
-
Multiview photometric stereo.IEEE Trans Pattern Anal Mach Intell. 2008 Mar;30(3):548-54. doi: 10.1109/TPAMI.2007.70820. IEEE Trans Pattern Anal Mach Intell. 2008. PMID: 18195448
-
A linear programming approach to max-sum problem: a review.IEEE Trans Pattern Anal Mach Intell. 2007 Jul;29(7):1165-79. doi: 10.1109/TPAMI.2007.1036. IEEE Trans Pattern Anal Mach Intell. 2007. PMID: 17496375 Review.
Cited by
-
Three-dimensional reconstruction and measurements of zebrafish larvae from high-throughput axial-view in vivo imaging.Biomed Opt Express. 2017 Apr 26;8(5):2611-2634. doi: 10.1364/BOE.8.002611. eCollection 2017 May 1. Biomed Opt Express. 2017. PMID: 28663894 Free PMC article.
-
Multiview stereo and silhouette fusion via minimizing generalized reprojection error.Image Vis Comput. 2015 Jan 1;33:1-14. doi: 10.1016/j.imavis.2014.10.008. Image Vis Comput. 2015. PMID: 25558120 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials
Miscellaneous
