Detailed spatio-temporal reconstruction of eyelids

A. Bermano, T. Beeler, Y. Kozlov, D. Bradley, B. Bickel, M. Gross, in:, ACM, 2015.

Download
No fulltext has been uploaded. References only!

Conference Paper | Published | English
Author
; ; ; ; ;
Department
Abstract
In recent years we have seen numerous improvements on 3D scanning and tracking of human faces, greatly advancing the creation of digital doubles for film and video games. However, despite the high-resolution quality of the reconstruction approaches available, current methods are unable to capture one of the most important regions of the face - the eye region. In this work we present the first method for detailed spatio-temporal reconstruction of eyelids. Tracking and reconstructing eyelids is extremely challenging, as this region exhibits very complex and unique skin deformation where skin is folded under while opening the eye. Furthermore, eyelids are often only partially visible and obstructed due to selfocclusion and eyelashes. Our approach is to combine a geometric deformation model with image data, leveraging multi-view stereo, optical flow, contour tracking and wrinkle detection from local skin appearance. Our deformation model serves as a prior that enables reconstruction of eyelids even under strong self-occlusions caused by rolling and folding skin as the eye opens and closes. The output is a person-specific, time-varying eyelid reconstruction with anatomically plausible deformations. Our high-resolution detailed eyelids couple naturally with current facial performance capture approaches. As a result, our method can largely increase the fidelity of facial capture and the creation of digital doubles.
Publishing Year
Date Published
2015-07-27
Volume
34
Issue
4
Article Number
44
Conference
SIGGRAPH: Special Interest Group on Computer Graphics and Interactive Techniques
Conference Location
Los Angeles, CA, United States
Conference Date
2015-08-09 – 2015-08-13
IST-REx-ID

Cite this

Bermano A, Beeler T, Kozlov Y, Bradley D, Bickel B, Gross M. Detailed spatio-temporal reconstruction of eyelids. In: Vol 34. ACM; 2015. doi:10.1145/2766924
Bermano, A., Beeler, T., Kozlov, Y., Bradley, D., Bickel, B., & Gross, M. (2015). Detailed spatio-temporal reconstruction of eyelids (Vol. 34). Presented at the SIGGRAPH: Special Interest Group on Computer Graphics and Interactive Techniques, Los Angeles, CA, United States: ACM. https://doi.org/10.1145/2766924
Bermano, Amit, Thabo Beeler, Yeara Kozlov, Derek Bradley, Bernd Bickel, and Markus Gross. “Detailed Spatio-Temporal Reconstruction of Eyelids,” Vol. 34. ACM, 2015. https://doi.org/10.1145/2766924.
A. Bermano, T. Beeler, Y. Kozlov, D. Bradley, B. Bickel, and M. Gross, “Detailed spatio-temporal reconstruction of eyelids,” presented at the SIGGRAPH: Special Interest Group on Computer Graphics and Interactive Techniques, Los Angeles, CA, United States, 2015, vol. 34, no. 4.
Bermano A, Beeler T, Kozlov Y, Bradley D, Bickel B, Gross M. 2015. Detailed spatio-temporal reconstruction of eyelids. SIGGRAPH: Special Interest Group on Computer Graphics and Interactive Techniques vol. 34.
Bermano, Amit, et al. Detailed Spatio-Temporal Reconstruction of Eyelids. Vol. 34, no. 4, 44, ACM, 2015, doi:10.1145/2766924.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar