Skip to content
Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Download Free Animation Software – Let's Learn How to Do Everything!

  • Step-by-Step MMD instructions
  • DOWNLOADS
  • Troubleshoot, Fix MMD
  • Site Contents
  • Reggie Replies Q&A
  • Homework!
  • What IS MMD?
    • Download MikuMikuDance Newest Latest Version of MMD
  • “HOW TO”
    • Raycast RAY-MMD Effect Tutorials
  • BONUS PAGES
    • Why convert PMD models to PMX?
  • HALL of CHAMPIONS
  • Tutorial Categories
  • About
    • Privacy Policy
  • Toggle search form
  • Use Center Position Bias to duplicate a motion Functions-Copy-Paste-Expand
  • MMD has an EXPAND function that lets you adjust a motion's speed.
    EXPAND function modifies MMD motion tempo EXPAND a motion
  • Why MMD cannot open the models in a saved PMM file Downloading New Models
  • PMXEditor Quickly Edits MMD Model using Downloaded Parts BigPerryman
  • Gotta Sing... Gotta Dance! LearnMMD's Video Dojo Expo-3!
    Gotta SING… Gotta DANCE! LearnMMD’s Video Dojo Expo-3! CONTESTS
  • Use YouTube Video Analytics to Attract and maintain viewers!
    Use YouTube Video Analytics Attract Maintain Viewers "the making of" my video
  • PMDE Q&A – Making clothes follow model motions Fixing Broken Models
  • Editing Effect Textures Creates Brand New Effects! Chestnutscoop

Speech Synthesizer gives MMD Models a voice!

Posted on March 15, 2017June 9, 2017 By Trackdancer No Comments on Speech Synthesizer gives MMD Models a voice!

A feature article on LearnMMD by Trackdancer2015!How do I make my Vocaloid model talk instead of sing? Where can I get a speech synthesizer to read my script? How can I give a voice to my MMD model?

Vocaloid software is basically a speech synthesis application. But it is designed specifically for singing rather than for speaking… and on top of that, since almost all Vocaloid software is made in Japan to sing in Japanese, it is not readily applicable for use in English speech applications!

By speech here, I mean “talking”…

Use a speech synthesizer to lend a speaking-voice to your MMD model!Making your
Vocaloid talk…

Speech Synthesizer gives MMD Models a voice!

So why would you want your Vocaloid to be able to talk? Well, there’s tons of things you can do with them if you can make them talk. For example they can tell jokes or act in drama animations. There’s tons of these types of animations on YouTube but they all tend to use speech clips from TV programs or movies… which is fine if you just want to make a parody, as many people do.

But what if you want “original” speech; to make them say exactly what you want?

There are two methods:

  1. Have someone do the voice acting for you. This is probably the best method but the problem is finding someone that you can trust to do a proper job; and this can be really hard. Apart from anything else, the voice actor needs to be able to “act”. Also, the logistics of using this method can be difficult to organize.
  2. Use a speech synthesizer; and that’s what we will discuss in this article as it is relatively easy and cheap to do.

So what will you need to do a talking animation?

  • MMD
  • Audacity
  • A script
  • A speech synthesizer
  • Some method to record the speech

Creating the motion and lip sync for a speech animation uses exactly the same software as other MMD animation projects and these are covered in articles elsewhere. To sum up you need MMD to make the main animation and MOGG Face and Lips for making the lip sync (or you can do this manually in MMD also).

Write your script to be
“read aloud” by the speech synthesizer…

As far as the script is concerned; this is best typed into either a word processor or notepad. But, you won’t necessarily type-out the words as they are normally written; instead, write them the way they are to be spoken by the device. Most speech synthesizers will sound a little mechanical and can also do


ADVERTISEMENT


funny things with pronunciations… like they will not know the difference between words like “read” (reed) and “read” (red) as in the sentence “I read the book”… so you might want to intentionally misspell or mis-punctuate as you write in order to trick the synthesizer into pronouncing the words as you intend. Also, voice synthesizers are terrible with timing. Simply; they will process an entire script without pause even though in real life, we don’t speak in a stream of talk; as besides anything else, we need to breathe! But I’ll come back to explain how to do this with a speech synthesizer after we find one that can be used.

And we’re going to be really cheap too. You don’t need to buy one as there’s some around for free…

Free Speech Synthesizers…

If your script is in English, the speech synthesizer in MS Office is an ideal candidate. It’s called Lisa and is usually used as an aid for people who have some need to be able to hear what was typed into a word document. Lisa is very mechanical, at least in the version of her that I have which is bundled into the MS Office 2003 package.

Then again, you can get away with a Vocaloid sounding somewhat mechanical. After all, their singing isn’t exactly “human” sounding either.

But you can also use the speech synthesizer built into Google Translate which is almost human sounding. Speaking in Japanese or other languages of this type, it sounds very natural and the voice quality is very pleasant too. Plus of course, it is totally free. In fact, you can type your script in English and have the program speak the Japanese translation. Google Translate has a speech function for all of the world’s major languages.

To use it is really simple. Paste in your script one paragraph at a time. Then have the program speak it by accessing the speaker icon and record it.
Google Translate speech synthesizer can "read" your text out loud!
To record it, simply use the microphone on your laptop to record the speech as it is being read. Unless your laptop speakers are really good, I suggest you use a set of good external speakers to produce the audio.

In case this is not obvious, you will want to be in a really quiet space when recording. You will also need a program that can manage the recording process and Audacity serves well for this function.

Record one paragraph at a time…
… and edit the clips together.

Now since you’re recording one paragraph of the script at a time, you’ll end up with a whole collection of audio clips. To make it into an integral whole you will need to splice it together with Audacity – this allows you to mess with the timing and this is how to add pauses in your final audio. You also want to break up your script as the Google translate speech synthesizer can be problematic with huge amounts of text.

You can also use Audacity to change the voice quality. Since the Google Translate speech synthesizer uses an adult voice, raising the pitch, for example, will make it sound younger; and adding more treble will make it sound brighter. In fact, you will be surprised at how much you can change in terms of the final voice quality. So for example, you can make a male voice sound female and vice versa.

Once you have your final speech engineered just export it as a WAV file and you’re ready to do the rest of the animation. It really is that simple.

Anyway, I’ll include some example videos that I did using some of the methods outlined here.

The first example simply uses an audio clipping from the Lord of the Rings DVD.

The second example also uses an audio clipping from the same DVD, but the original speech was spoken by Aragon, who is a guy; at least the last time we checked. But in the clip I have Neru making the same speech. To make the speech sound “female”, I re-engineered the clip with Audacity.

But to make an original speech animation, I used MS Office 2003’s Lisa and tweaked it so that it sounds like it is being spoken by a chibi. Arguably, Google Translate’s voice synthesizer would have produced a much more natural sounding voice, but when this video was made that wasn’t an option.

Thanks for reading.

CREDITS:
Top Image:
Chibi IA v2.0 – Mqdl/Kiyo/Trackdancer
MMD 9.26
Image processed using Irvanview

 


– SEE BELOW for MORE MMD TUTORIALS…


— — —


– _ — –


Visit the LearnMMD.com Homepage! Plenty of Mikumikudance instruction and info!

More MMD Tutorials...

Reader asks how to create MMD artwork... stuff like posing, camerawork?

A reader asks... Is there a tutorial on how to create MMD artwork, like those you ...read more

Learn MikuMikuDance in Small Steps! New LearnMMD Video Series

Learn MikuMikuDance in Small Steps. Where can I find easy-to-follow MMD instructions on YouTube? How ...read more

Apply Multiple Effects on an Entire MMD Model Using M4Layer Effect

How can I apply multiple effects to an MMD model? Can I use more than ...read more

MMD Plugin Manager... I Found a Treasure!

What sorts of MMD Plugins are there? MMD Plugin Manager? MMD Plugins. Plugin MMD. More ...read more

2023: Hatsune Miku is 16 Years Old by design and in reality!

Finally, in 2023, Hatsune Miku is 16 years old! When did Miku make her first ...read more

SEARCH LearnMMD.com... it's Easy!

Search LearnMMD.com to find your answers! With the posting of this article, LearnMMD.com has 758 tutorials ...read more

Making Soundtracks, MMD Tutorials, Speech Synthesizer, Trackdancer2015

Post navigation

Previous Post: The Making of “Viva La Vida MMD” by Zazi The Angel
Next Post: The Making Of my “I Know Those Eyes / This Man Is Dead MMD” video

Related Posts

  • MMD Fill Lights Part 1 (Half-Lambert Shader) Half-Lambert Shader
  • MMD Light Manipulation Panel helps set the mood Global Lighting
  • Ray-MMD: Lost in the Fog
    Ray-MMD Localized Fog Effects for stunning MMD scenes MMD Tutorials
  • Beautiful CyberMiku Black ver1.5 has wings!
    Download MMD CyberMiku Black ver1.5 with Glowing Wings and an attitude! "the making of" my video
  • Blackout Effect offers Fade-to-Black and fade-to-white!
    MME Blackout Effect offers Fade-to-Black and Fade-to-White Blackout Effect
  • Professionally made models FOUND! Downloading New Models

More Related Articles

Creating an animation using MMD, MikuMikuDance! "the making of" my video
modified MMD effects can yield NEW surprises! Modified MME Effects Files yield NEW Effects for MMD! Customize MME effects
o_ShaderCustomSet_v0_3 effect applies gentle color modification MMD Tutorials
Vocaloids and MMD: It’s all about the Music!! Random Thoughts & Visions
No Diamonds Appear in Frame Chart in MMD and How to Fix It Mae Blythe
New Interpolation Curve Video was fun to make! "the making of" my video

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Download the latest version of MikuMikuDance!
See the MMD Step-by-Step instructions page!
Learn how to make your own MMD motions!
LearnMMD.com
  • MMD First Steps Make your own motions from scratch Making Smooth Motions
  • Announcing The 2013 Momi Cup Celebration. ARIZONA
  • Make Your YouTube Channel Popular with Engrossing Introductions MMD Basics
  • My First MMD Video – After Struggling with Blender, MMD was Easy "the making of" my video
  • VDE-4 Champion: Lluiji Video Dojo Champions
  • Free Download MikuMikuDance MMD
    Free Download MikuMikuDance 3D animation software Intro to MikuMikuDance
  • Show the Love: Melanie’s “Ring Around the Moon” CONTESTS
  • Introduction to Vocaloid: a short tutorial NOKO2

Copyright © 2022 Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software and Instructions..

Powered by PressBook Premium theme

Go to mobile version