Multiview photometric stereo
- PMID: 18195448
- DOI: 10.1109/TPAMI.2007.70820
Multiview photometric stereo
Abstract
This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialise a multi-view photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: Firstly we describe a robust technique to estimate light directions and intensities and secondly, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and hence allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how even in the case of highly textured objects, this technique can greatly improve on correspondence-based multi-view stereo results.
Similar articles
-
Example-based photometric stereo: shape reconstruction with general, varying BRDFs.IEEE Trans Pattern Anal Mach Intell. 2005 Aug;27(8):1254-64. doi: 10.1109/TPAMI.2005.158. IEEE Trans Pattern Anal Mach Intell. 2005. PMID: 16119264
-
Multiflash stereopsis: depth-edge-preserving stereo with small baseline illumination.IEEE Trans Pattern Anal Mach Intell. 2008 Jan;30(1):147-59. doi: 10.1109/TPAMI.2007.1136. IEEE Trans Pattern Anal Mach Intell. 2008. PMID: 18000331
-
Dense photometric stereo: a Markov random field approach.IEEE Trans Pattern Anal Mach Intell. 2006 Nov;28(11):1830-46. doi: 10.1109/TPAMI.2006.224. IEEE Trans Pattern Anal Mach Intell. 2006. PMID: 17063687
-
An Overview on Image-Based and Scanner-Based 3D Modeling Technologies.Sensors (Basel). 2023 Jan 4;23(2):596. doi: 10.3390/s23020596. Sensors (Basel). 2023. PMID: 36679393 Free PMC article. Review.
-
[An update on the lighting of a dental outpatient office].Minerva Stomatol. 1993 Mar;42(3):97-106. Minerva Stomatol. 1993. PMID: 8321169 Review. Italian.
Cited by
-
Noncontact speckle contrast diffuse correlation tomography of blood flow distributions in tissues with arbitrary geometries.J Biomed Opt. 2018 Sep;23(9):1-9. doi: 10.1117/1.JBO.23.9.096005. J Biomed Opt. 2018. PMID: 30251483 Free PMC article.
-
A fast 3D reconstruction system with a low-cost camera accessory.Sci Rep. 2015 Jun 9;5:10909. doi: 10.1038/srep10909. Sci Rep. 2015. PMID: 26057407 Free PMC article.
-
A Review of Depth and Normal Fusion Algorithms.Sensors (Basel). 2018 Feb 1;18(2):431. doi: 10.3390/s18020431. Sensors (Basel). 2018. PMID: 29389903 Free PMC article.
-
Real-time molecular imaging of near-surface tissue using Raman spectroscopy.Light Sci Appl. 2022 Apr 8;11(1):90. doi: 10.1038/s41377-022-00773-0. Light Sci Appl. 2022. PMID: 35396506 Free PMC article.
-
Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction.Sensors (Basel). 2022 Oct 25;22(21):8172. doi: 10.3390/s22218172. Sensors (Basel). 2022. PMID: 36365869 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources