For best Lip Sync results:
Use a forward-facing shot of a single person’s face.
Consider camera distance
If the character is too far from the camera, lip movement may not come through clearly.
If the character is too close, facial expressions may appear distorted.
Choose audio with clear speech and no cross-talk.
For clearer movement use AudioShake Stem Separator to extract the vocals from your audio. Add the full audio back in edit.
Test outputs with a short section of audio before creating a longer video.
Image Lip Sync
Create a lip sync video by adding audio to an image of a person.
Length: will match audio up to 60 seconds.
To use Image Lip Sync:
In the Create Video Flow menu select Image Lip Sync.
Add your image and audio to the Flow.
Click the generate button to create your video.
Tips for working with Image Lip Sync:
Image Lip Sync may add movement to the character and background. Use a close view of your characters face to limit extra movement.
The intensity of the audio will affect the character’s expression.
Video Lip Sync
Create a lip sync video by adding audio to a video of a person.
Length: will match shortest of your uploaded media up to 60 seconds.
To use Video Lip Sync:
In the Create Video Flow select Video Lip Sync.
Add your video and audio to the Flow.
Click the generate button to create your video.
Use Video Lip Sync to:
Create lip sync videos with dynamic character and background movement.
Add new or translated audio to a character in an existing video.
For best results with Video Lip Sync choose a video where:
The character’s face is clear and stays in the shot for the entire video.
The character’s movement is smooth.
The character is stationary or the camera tracks the character’s face as they move.
The character is not talking in the original video.
We recommend testing with short clips to refine your settings before committing to longer videos.