フェイシャルパフォーマンス：データ収集プロトコルに不可欠な3つのヒント

フェイシャルキャプチャーのプロトコルを設計する際には、質の低いデータ収量や参加者の疲労を防ぐために考慮しなければならないことがたくさんあります。

例えば...

どんなポーズを選ぶか
ポーズの順番
ポーズの説明や見せ方など。

...セッションの仕上がりに大きな違いをもたらす。

Working with major game and tech companies to refine their facial performance capture pipelines, it’s quite obvious that people are recycling similar, dated protocols. Considering the present purpose of many captures, such old protocols are often clunky with illogical pose combinations, redundant expressions, and inefficient flow.

フェイシャル・キャプチャーのデザインに関する注意点は枚挙にいとまがないが、ここでは一般的なポイントをいくつか紹介しよう：

1. Be use case-minded!

Are you defining machine learning training data for real-time applications? Are you gathering extreme poses for high-intensity fight scenes in film or games? Think about your end goal.

If your purpose is to capture facial data for an avatar product aimed toward co-working, you’d likely want to prioritize prosocial, collaborative, and natural facial expressions. Stop wasting time, energy, and production budget by bloating your session with every possible unsightly “scream” pose or hyper-compressed “lemon” face. Save those for Diablo そして Planet of the Apes.

2. Design for logical flow.

Group similar expressions together, e.g. brow-based FACS poses (action units like – inner brow raiser, outer brow raiser, brow lowerer) and eye-based FACS poses (action units like – upper lid raiser, lid tightener, cheek raiser, eye closure, blink, wink) together.
Go from easy to difficult within each section. If you move from easy to difficult across ALL poses, you will end up forcing your user to leap from eyes to mouth to brows to jaw.
Grouping expressions strategically not only helps with user fatigue and comprehension, but it also opens up opportunity to order your poses in a way that allows you to describe and build off previous ones.

3. Make sure your example imagery and descriptions match the target pose and intended blendshapes.

Too many times, I see prompts like “raise brows without widening eyes” – yet the actor in the example shot is clearly widening their eyes. A large percentage of users will do as they see, not as they hear or read. So, don’t give conflicting instructions, and make sure you rigorously review the example poses!

📝 もうひとつのヒント:ビデオでは、"push up your bottom lip."（下唇を押し上げる）と言って、顎を上げる動作を促していることに注目してほしい。ポーズを正式名称で説明することにとらわれがちですが、もっと親しみやすい表現を使うことで、参加者がポーズを取る可能性を高めることができます。