-> 3.6.7 Pitch Tune
Contents:
Pitch
The pitch of human voice is non-mechanical. Even when human sings a fixed note, there are fluctuations in pitch at each moment. The variation of pitch is not only a guarantee of naturalness of human voice, but also an important embodiment of astonishing singing performance. After obtaining the notes, phonemes, and consonant durations, the Verse2023 model synthesizes ultra-expressive pitch lines for each AI singer and displays them above the notes.
After selecting one of the Pitch editing tools above, the singing editor grid will enter Pitch editing mode. In this mode, the notes cannot be edited, and it will take a brief moment for AI to synthesize the default Pitch line (referred to as "AI Pitch") for the current clip.
The AI Pitch is presented as a white, semi-transparent line. The Pitch line manually drawn with the Pitch editing tool is presented as a white, opaque line (referred to as "User Pitch"). The User Pitch overlays the AI Pitch, and the overlaid Pitch line will be used for subsequent AI parameter rendering and voice synthesis.
Pitch Brush (Shortcut key [1]):
- Use the left mouse button or digital pen on the singing editor grid to draw continuous User Pitches. Use the right mouse button to erase User Pitches.
- Overlapping pitch anchor points and segments will be erased simultaneously when drawn.
- User pitch drawn in areas without AI Pitch will appear as dashed lines, indicating that the pitch segment is not effective.
Pitch Anchors (Shortcut key [1]):
- After selecting the Pitch brush, click again to select the Pitch Anchor tool from the drop-down menu.
- Double-click to create an anchor point in the singing editor grid to enter connection mode. Click the left mouse button continuously to create multiple anchor points, which will automatically connect into a User Pitch line. Double-click again or use the right mouse button or [Esc] to exit connection mode and complete the drawing of a pitch line.
- During drawing, the anchor point line segment will overlay the User Pitch drawn by the Pitch brush.
- If User Pitch is connected in an area without AI Pitch, the Pitch line segment will also become a dashed line, indicating that the Pitch line segment is not effective.
Pitch Fix Brush (Shortcut key [2]):
Because each singing segment requires context information such as notes, lyrics, and consonant duration for AI pitch synthesis, changes to any of these contextual factors within a synthesized segment or even adjacent segments may require re-synthesizing. Re-synthesizing may cause the AI Pitch within the segment to differ from the previous output due to contextual changes. If you do not want any changes in the contextual factors to affect the AI pitch, you can use the Pitch Fix Brush to brush the AI pitch to the User Pitch with the left mouse button.For more information on segmenting synthesis segments, please refer to [
3.10-AI Parameters and Synthesis].
Pitch Eraser (shortcut key [3]):
Select the Pitch Eraser tool to erase the user pitch by left-clicking.
Vibrato Tool(shortcut key [4]):
Although AI Pitch sometimes generates vibrato effects based on the singer's singing style, if you need precise control over the vibrato, you can use the Vibrato tool.
After selecting the Vibrato tool, drag on a note to create a vibrato envelope that extends backward from the end of the note. Before releasing the mouse button, you can:
- Drag horizontally to adjust the range of the vibrato
- Drag vertically to adjust the amplitude of the vibrato
After releasing the mouse button, you will get the initial vibrato envelope applied to the note. You can then:
- Drag the left boundary to adjust the range of the vibrato
- Drag the upper left corner to adjust the amplitude of the vibrato
- Drag the lower left corner to adjust the phase of the vibrato
- Drag the lower right corner to adjust the frequency of the vibrato
- Drag the middle circles to adjust the envelope for the attack and decay of the vibrato
When editing the vibrato, the white translucent line segment indicates the pitch before the vibrato envelope is applied, while the yellow line segment indicates the pitch after the vibrato envelope is applied.
You can select any vibrato envelope by clicking on it, then edit it or delete it using the [Delete]/[Backspace] key. You can also select multiple vibrato envelopes by dragging a selection around them, then delete them together.
Pitch Modulation (shortcut key [5]):
After selecting the Pitch Modulation tool, drag vertically on a note to adjust the smoothness of the Pitch within the vowel range of the note. The Pitch within the adjusted range will be changed to User Pitch.
You can adjust an individual note, or adjust selected multiple notes.
If you drag on a consonant, the tool will only affect that specific consonant. If you hold down [Shift] while dragging on a note, the tool will affect the entire note range.