High-quality passive facial performance capture using anchor frames

Beeler T, Hahn F, Bradley D, Bickel B, Beardsley P, Gotsman C, Sumner R, Groß M. 2011. High-quality passive facial performance capture using anchor frames. ACM Transactions on Graphics. 30(4).

Download
No fulltext has been uploaded. References only!

Journal Article | Published
Author
Beeler, Thabo; Hahn, Fabian; Bradley, Derek J; Bickel, BerndIST Austria ; Beardsley, Paul A; Gotsman, Craig; Sumner, Robert W; Groß, Markus S
Abstract
We present a new technique for passive and markerless facial performance capture based on anchor frames. Our method starts with high resolution per-frame geometry acquisition using state-of-theart stereo reconstruction, and proceeds to establish a single triangle mesh that is propagated through the entire performance. Leveraging the fact that facial performances often contain repetitive subsequences, we identify anchor frames as those which contain similar facial expressions to a manually chosen reference expression. Anchor frames are automatically computed over one or even multiple performances. We introduce a robust image-space tracking method that computes pixel matches directly from the reference frame to all anchor frames, and thereby to the remaining frames in the sequence via sequential matching. This allows us to propagate one reconstructed frame to an entire sequence in parallel, in contrast to previous sequential methods. Our anchored reconstruction approach also limits tracker drift and robustly handles occlusions and motion blur. The parallel tracking and mesh propagation offer low computation times. Our technique will even automatically match anchor frames across different sequences captured on different occasions, propagating a single mesh to all performances.
Publishing Year
Date Published
2011-07-01
Journal Title
ACM Transactions on Graphics
Volume
30
Issue
4
IST-REx-ID

Cite this

Beeler T, Hahn F, Bradley D, et al. High-quality passive facial performance capture using anchor frames. ACM Transactions on Graphics. 2011;30(4). doi:10.1145/2010324.1964970
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., … Groß, M. (2011). High-quality passive facial performance capture using anchor frames. ACM Transactions on Graphics. ACM. https://doi.org/10.1145/2010324.1964970
Beeler, Thabo, Fabian Hahn, Derek Bradley, Bernd Bickel, Paul Beardsley, Craig Gotsman, Robert Sumner, and Markus Groß. “High-Quality Passive Facial Performance Capture Using Anchor Frames.” ACM Transactions on Graphics. ACM, 2011. https://doi.org/10.1145/2010324.1964970.
T. Beeler et al., “High-quality passive facial performance capture using anchor frames,” ACM Transactions on Graphics, vol. 30, no. 4. ACM, 2011.
Beeler T, Hahn F, Bradley D, Bickel B, Beardsley P, Gotsman C, Sumner R, Groß M. 2011. High-quality passive facial performance capture using anchor frames. ACM Transactions on Graphics. 30(4).
Beeler, Thabo, et al. “High-Quality Passive Facial Performance Capture Using Anchor Frames.” ACM Transactions on Graphics, vol. 30, no. 4, ACM, 2011, doi:10.1145/2010324.1964970.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar