Marker Optimization for Facial Motion Acquisition and Deformation
Binh Huy Le, Mingyang Zhu, and Zhigang Deng
IEEE Transactions on Visualization and Computer Graphics (TVCG), (accepted in May 2013)
Abstract: A long-standing problem in marker-based facial motion capture is what are the optimal facial mocap marker layouts. Despite its wide range of potential applications, this problem has not yet been systematically explored to date. This paper describes an approach to compute optimized marker layouts for facial motion acquisition as optimization of characteristic control points from a set of high-resolution, ground-truth facial mesh sequences. Specifically, the thin-shell linear deformation model is imposed onto the example pose reconstruction process via optional hard constraints such as symmetry and multi-resolution constraints. Through our experiments and comparisons, we validate the effectiveness, robustness, and accuracy of our approach. Besides guiding minimal yet effective placement of facial mocap markers, we also describe and demonstrate its two selected applications: marker-based facial mesh skinning and multi-resolution facial performance capture.
Video on Youtube
Bibtex
@article{BinhLe:TVCG:2013,
author = {Binh H. Le and Mingyang Zhu and Zhigang Deng},
title = {Marker Optimization for Facial Motion Acquisition and Deformation},
journal ={IEEE Transactions on Visualization and Computer Graphics},
volume = {xx},
number = {xx},
year = {2013},
pages = {(to appear)}
}