For best Lip Sync results:
Use a forward-facing shot of a single person’s face.
Consider camera distance
If the character is too far from the camera, lip movement may not come through clearly.
If the character is too close, facial expressions may appear distorted.
Choose audio with clear speech and no cross-talk.
For clearer movement use AudioShake Stem Separator to extract the vocals from your audio. Add the full audio back in edit.
Image Lip Sync
Create a lip sync video by adding audio to a still image of a person.
Flow: Image + Audio to Video.
Length: will match audio up to 60 seconds.
Cost: 5 credits/second.
To use Image Lip Sync:
Add your image and audio to the Image Lip Sync Flow.
Use the slider to adjust the Expression Level (0-1).
Higher Expression = more lip and facial movement.
Lower Expression = more subtle motion.
Tips:
If your character's mouth movements look exaggerated or their face is warping, lower the expression level.
If your character's mouth movements are under-defined or mumbly increase the expression level.
The intensity of the audio will also affect the character’s expression.
Video Lip Sync
Create a lip sync video by adding audio to a video of a person.
Flow: Video + Audio to Video.
Length: will match shortest of your uploaded media up to 60 seconds.
Cost: Standard Quality 1 credits/second; High Quality 3credits/second.
To use Video Lip Sync:
Add your video and audio to the Video Lip Sync Flow.
Choose between Standard or High Quality settings.
Use Video Lip Sync to:
Create lip sync videos with dynamic character and background movement.
Add new or translated audio to a character in an existing video.
For best results choose a video where:
The character’s face is clear and stays in the shot for the entire video.
The character’s movement is smooth.
The character is stationary or the camera tracks the character’s face as they move.
We recommend testing with short clips to refine your settings before committing to longer videos.