Coupled 3D reconstruction of sparse facial hair and skin

T. Beeler, B. Bickel, G. Noris, P. Beardsley, S. Marschner, R. Sumner, M. Groß, ACM Transactions on Graphics 31 (2012).

Download
No fulltext has been uploaded. References only!

Journal Article | Published
Author
Beeler, Thabo; Bickel, BerndIST Austria ; Noris, Gioacchino; Beardsley, Paul A; Marschner, Steve; Sumner, Robert W; Groß, Markus S
Abstract
Although facial hair plays an important role in individual expression, facial-hair reconstruction is not addressed by current facecapture systems. Our research addresses this limitation with an algorithm that treats hair and skin surface capture together in a coupled fashion so that a high-quality representation of hair fibers as well as the underlying skin surface can be reconstructed. We propose a passive, camera-based system that is robust against arbitrary motion since all data is acquired within the time period of a single exposure. Our reconstruction algorithm detects and traces hairs in the captured images and reconstructs them in 3D using a multiview stereo approach. Our coupled skin-reconstruction algorithm uses information about the detected hairs to deliver a skin surface that lies underneath all hairs irrespective of occlusions. In dense regions like eyebrows, we employ a hair-synthesis method to create hair fibers that plausibly match the image data. We demonstrate our scanning system on a number of individuals and show that it can successfully reconstruct a variety of facial-hair styles together with the underlying skin surface.
Publishing Year
Date Published
2012-01-01
Journal Title
ACM Transactions on Graphics
Volume
31
Issue
4
IST-REx-ID

Cite this

Beeler T, Bickel B, Noris G, et al. Coupled 3D reconstruction of sparse facial hair and skin. ACM Transactions on Graphics. 2012;31(4). doi:10.1145/2185520.2185613
Beeler, T., Bickel, B., Noris, G., Beardsley, P., Marschner, S., Sumner, R., & Groß, M. (2012). Coupled 3D reconstruction of sparse facial hair and skin. ACM Transactions on Graphics, 31(4). https://doi.org/10.1145/2185520.2185613
Beeler, Thabo, Bernd Bickel, Gioacchino Noris, Paul Beardsley, Steve Marschner, Robert Sumner, and Markus Groß. “Coupled 3D Reconstruction of Sparse Facial Hair and Skin.” ACM Transactions on Graphics 31, no. 4 (2012). https://doi.org/10.1145/2185520.2185613.
T. Beeler et al., “Coupled 3D reconstruction of sparse facial hair and skin,” ACM Transactions on Graphics, vol. 31, no. 4, 2012.
Beeler T, Bickel B, Noris G, Beardsley P, Marschner S, Sumner R, Groß M. 2012. Coupled 3D reconstruction of sparse facial hair and skin. ACM Transactions on Graphics. 31(4).
Beeler, Thabo, et al. “Coupled 3D Reconstruction of Sparse Facial Hair and Skin.” ACM Transactions on Graphics, vol. 31, no. 4, ACM, 2012, doi:10.1145/2185520.2185613.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar