Skip to the content.

MIG2020: Investigating perceptually based models to predict importance of facial blendshapes

This package contains:

These files are associated with the following publication:

Emma Carrigan, Katja Zibrek, Rozenn Dahyot, and Rachel McDonnell. 2020. Investigating perceptually based models to predict importance of facial blendshapes. In Motion, Interaction and Games (MIG ‘20). Association for Computing Machinery, New York, NY, USA, Article 2, 1–6. DOI:10.1145/3424636.3426904

Please cite this conference paper (see PDF) when using this code and data. This paper was awarded Best Short Paper at MIG2020.

Using bibtex format:

@inproceedings{10.1145/3424636.3426904,
author = {Carrigan, Emma and Zibrek, Katja and Dahyot, Rozenn and McDonnell, Rachel},
title = {Investigating Perceptually Based Models to Predict Importance of Facial Blendshapes},
year = {2020},
isbn = {9781450381710},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3424636.3426904},
doi = {10.1145/3424636.3426904},
abstract = {Blendshape facial rigs are used extensively in the industry for facial animation of 
virtual humans. However, storing and manipulating large numbers of facial meshes is costly
in terms of memory and computation for gaming applications, yet the relative perceptual 
importance of blendshapes has not yet been investigated. Research in Psychology and Neuroscience
has shown that our brains process faces differently than other objects, so we postulate that 
the perception of facial expressions will be feature-dependent rather than based purely on the 
amount of movement required to make the expression. In this paper, we explore the noticeability
of blendshapes under different activation levels, and present new perceptually based models to
predict perceptual importance of blendshapes. The models predict visibility based on commonly-used 
geometry and image-based metrics. },
booktitle = {Motion, Interaction and Games},
articleno = {2},
numpages = {6},
keywords = {perception, blendshapes, linear model, action units},
location = {Virtual Event, SC, USA},
series = {MIG '20}
}

Author and Repo webpage