Facial performance enhancement using dynamic shape space analysis

Bermano A, Bradley D, Beeler T, Zund F, Nowrouzezahrai D, Baran I, Sorkine Hornung O, Pfister H, Sumner R, Bickel B, Groß M. 2014. Facial performance enhancement using dynamic shape space analysis. ACM Transactions on Graphics. 33(2).

Download
No fulltext has been uploaded. References only!

Journal Article | Published
Author
Bermano, Amit H; Bradley, Derek J; Beeler, Thabo; Zund, Fabio; Nowrouzezahrai, Derek; Baran, Ilya; Sorkine-Hornung, Olga; Pfister, Hanspeter; Sumner, Robert W; Bickel, BerndIST Austria ; Groß, Markus S
Abstract
The facial performance of an individual is inherently rich in subtle deformation and timing details. Although these subtleties make the performance realistic and compelling, they often elude both motion capture and hand animation. We present a technique for adding fine-scale details and expressiveness to low-resolution art-directed facial performances, such as those created manually using a rig, via marker-based capture, by fitting a morphable model to a video, or through Kinect reconstruction using recent faceshift technology. We employ a high-resolution facial performance capture system to acquire a representative performance of an individual in which he or she explores the full range of facial expressiveness. From the captured data, our system extracts an expressiveness model that encodes subtle spatial and temporal deformation details specific to that particular individual. Once this model has been built, these details can be transferred to low-resolution art-directed performances. We demonstrate results on various forms of input; after our enhancement, the resulting animations exhibit the same nuances and fine spatial details as the captured performance, with optional temporal enhancement to match the dynamics of the actor. Finally, we show that our technique outperforms the current state-of-the-art in example-based facial animation.
Publishing Year
Date Published
2014-03-01
Journal Title
ACM Transactions on Graphics
Volume
33
Issue
2
IST-REx-ID

Cite this

Bermano A, Bradley D, Beeler T, et al. Facial performance enhancement using dynamic shape space analysis. ACM Transactions on Graphics. 2014;33(2). doi:10.1145/2546276
Bermano, A., Bradley, D., Beeler, T., Zund, F., Nowrouzezahrai, D., Baran, I., … Groß, M. (2014). Facial performance enhancement using dynamic shape space analysis. ACM Transactions on Graphics. ACM. https://doi.org/10.1145/2546276
Bermano, Amit, Derek Bradley, Thabo Beeler, Fabio Zund, Derek Nowrouzezahrai, Ilya Baran, Olga Sorkine Hornung, et al. “Facial Performance Enhancement Using Dynamic Shape Space Analysis.” ACM Transactions on Graphics. ACM, 2014. https://doi.org/10.1145/2546276.
A. Bermano et al., “Facial performance enhancement using dynamic shape space analysis,” ACM Transactions on Graphics, vol. 33, no. 2. ACM, 2014.
Bermano A, Bradley D, Beeler T, Zund F, Nowrouzezahrai D, Baran I, Sorkine Hornung O, Pfister H, Sumner R, Bickel B, Groß M. 2014. Facial performance enhancement using dynamic shape space analysis. ACM Transactions on Graphics. 33(2).
Bermano, Amit, et al. “Facial Performance Enhancement Using Dynamic Shape Space Analysis.” ACM Transactions on Graphics, vol. 33, no. 2, ACM, 2014, doi:10.1145/2546276.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar