sparten wrote: ↑Tue Apr 30, 2019 3:26 pm
how you get this perfect lips sync with audio !!? what is the way you use ?
Here's what I do:
1. import the dialog sound file for the scene to Moho.
If you've set up an animatic for your animation in a video editor, select the range for the scene and export the audio for that scene. Use .wav or .aif. Optionally, you can export the frames or movie file for that scene and place it in the corner as a reference. I recommend JPG with med to lo res because this is frame accurate and it streams well even across a network. In my experience separate audio file and jpg seq offers best performance for reference footage, but if you decide to go with a movie file, choose a codec that doesn't require a lot of processing and can play with frame accuracy, otherwise the codec may degrade Moho's performance while you try to animate.
2. Notate the audio dialog in timeline using Markers.
I do this for specific words and short phrases as I scrub through the track. This helps me read and understand the waveform.
When you add a marker, a box appears that lets you type in the dialog. If it's a few words or a short phrase, it will appear in the timeline. If you have multiple lines of text, you can see the entire text in the timeline by hovering your cursor over the marker; a tool tip will appear with the text. This 'long text' feature is good for detailed animation instructions; I suggest keeping it short for dialog.
BTW, you can color code the Markers. For example, I use different colors for animation instructions and dialog, and when multiple characters are involved, I may use different colors to represent each character. To change the color, right-click over the marker and choose a color from Label.
3. As mrmoi2000 explained, from here I just scrub/step through the track and keyframe my mouth shapes. Once you've done this a few times, you can animate an entire track of dialog in a few minutes. It just takes a little practice.
If you're new to this, I suggest getting familiar with standard mouth shapes like the Preston Blair set, and basing your Moho mouth shapes for your Switch layer on these shapes.
I also recommend using Moho's Switch Selection window. This a a very fast way to select and keyframe the mouth shapes as you listen to the audio.
Tip: Don't keyframe every syllable and sound. This can make the character's mouth animation look too snappy and unnatural. When real people talk, they do not mouth every sound. I suggest placing a small makeup mirror on your desk and studying how your mouth moves as you say the dialog.
4. After you've keyframed the mouth shapes, consider adding some secondary 'squash & stretch' to the mouths shapes by transforming the Switch layer itself. Be sure to place the Switch layer's origin in the center of the mouth drawing so the transforms scale from that point. This gives the mouth animation a nice smoothness not possible from simply switching shapes. If you look at the mouth shapes of the Boss Baby characters from
my 2019 demo reel, that's all we're doing there. It looks like we used a lot of mouth drawings for the animation, even though there are actually few mouth shapes inside the Switch layer.
The key is planning and practice. Import the track, get familiar with it; establish a workflow for animating the mouth; and just do it...and do it...and do it some more.
Creating lip sync animation with Moho really isn't that difficult in Moho, and it's surprisingly fun once you get the hang of it.