From sparse mocap to highly detailed facial animation

Bickel B, Lang M. 2011.From sparse mocap to highly detailed facial animation. In: GPU Computing Gems Emerald Edition. , 413–426.

Download
No fulltext has been uploaded. References only!

Book Chapter | Published
Author
Bickel, BerndIST Austria ; Lang, Manuel
Abstract
This chapter presents a method for real-time animation of highly detailed facial expressions based on sparse motion captures data and a limited set of static example poses. The method for real-time animation of highly detailed facial expressions decomposes geometry into large-scale motion and fine-scale details, such as expression wrinkles. Both large- and fine-scale deformation algorithms run entirely on the GPU, and our implementation based on CUDA achieves an overall performance of about 30 fps. The face conveys the most relevant visual characteristics of human identity and expression. Hence, realistic facial animations or interactions with virtual avatars are important for storytelling and gameplay. However, current approaches are either computationally expensive, require very specialized capture hardware, or are extremely labor intensive. At runtime, given an arbitrary facial expression, the algorithm computes the skin strain from the relative distance between marker points and derives fine-scale corrections for the largescale deformation. During gameplay only the sparse set of marker-point positions is transmitted to the GPU. The face animation is entirely computed on the GPU where the resulting mesh can directly be used as input for the rendering stages. This data can be easily obtained by traditional capture hardware. The proposed in-game algorithm is fast. It also is easy to implement and maps well onto programmable GPUs.
Publishing Year
Date Published
2011-01-01
Book Title
GPU Computing Gems Emerald Edition
Page
413 - 426
IST-REx-ID

Cite this

Bickel B, Lang M. From sparse mocap to highly detailed facial animation. In: GPU Computing Gems Emerald Edition. Science Direct; 2011:413-426. doi:10.1016/B978-0-12-384988-5.00027-9
Bickel, B., & Lang, M. (2011). From sparse mocap to highly detailed facial animation. In GPU Computing Gems Emerald Edition (pp. 413–426). Science Direct. https://doi.org/10.1016/B978-0-12-384988-5.00027-9
Bickel, Bernd, and Manuel Lang. “From Sparse Mocap to Highly Detailed Facial Animation.” In GPU Computing Gems Emerald Edition, 413–26. Science Direct, 2011. https://doi.org/10.1016/B978-0-12-384988-5.00027-9.
B. Bickel and M. Lang, “From sparse mocap to highly detailed facial animation,” in GPU Computing Gems Emerald Edition, Science Direct, 2011, pp. 413–426.
Bickel B, Lang M. 2011.From sparse mocap to highly detailed facial animation. In: GPU Computing Gems Emerald Edition. , 413–426.
Bickel, Bernd, and Manuel Lang. “From Sparse Mocap to Highly Detailed Facial Animation.” GPU Computing Gems Emerald Edition, Science Direct, 2011, pp. 413–26, doi:10.1016/B978-0-12-384988-5.00027-9.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar