LIP SYNC
Lip Sync is EP3 of Shape Shifters original IP and Unreal Engine animation series of short stories, and is an exploration into different story genres and more nuanced, sensual and complex character interaction. Our first cinematic staged and rendered completely in UE5, we found Lip Sync to be technically challenging but rewarding to execute, as we pushed hard to raise the quality bar of our animation and rendering, all while dealing with the learning curve of UE5.
Like all the content created by Shape Shifters, Lip Sync was rendered 100% real-time in the Unreal Engine, with the animation done mostly in Maya + XSens mocap.
Released
Feb 2022
Credits
Han Yang - Director + Creator
David Jiang - Character Lead
Eugene Flormata - UE Consultation
Andrea Bellucci - Music Composition
Chengshuo Hou - Sound Design
LIP SYNC
Our goal for Lip Sync was to create a real-time short featuring two high-fidelity digital human characters interacting closely with each other, a very technically challenging feat to pull of realistically. It took our small team of 3 artists and TDs 8 weeks to complete start to finish, our Character Lead, David Jiang., used the Metahuman Creator to drive the face meshes of the characters as part of our facial rigging and animation workflow. For more insight into that, please see our recent SIGGRAPH talk or check out our Avatars page. The body animation was done with a XSens mocap suit + cleanup in Maya, whereas the facial animation was done 100% in UE5 via edits from IPhone ARkit Capture
