In this tutorial we cover five ways to use speech recognition software to automatically add subtitles or captions to a video. We'll show you how to use the leading artificial intelligence technologies Adding subtitles to your videos is easier than it may seem, and brings all kinds of great benefits. Read on to find out how.
Add Subtitles Automatically in Premiere Pro (Subscription)
Adding subtitles to videos in Adobe's video editor is easier than ever. We have a full step-by-step tutorial on speech recognition in Premiere Pro, or watch the video below to learn how with Tom:
YouTube's Automatic Captioning (Free)
Creating subtitles with YouTube is easy, automatic transcription is built directly into the service, and can be edited in the Video Manager. Although the service does seem to be continually improving, YouTube's transcription is notoriously (and sometimes hilariously) imperfect. Thankfully, you have the option to manually adjust them.
How to Correct the Automatic Subtitles on YouTube
Select the Subtitles & CC option to view the subtitle settings, and then click on the subtitle file you want to alter. In my case, that is English (Automatic).
Now press the Edit button to begin adjusting them. On the left side, you'll see the transcription that YouTube automatically generated. You can type over any of the incorrect subtitles to correct them. Use the embedded video player to work your way through the video and intervene as needed. Click Publish Edits when you're finished to save the corrected subtitles.
To export and download a subtitle file, click the Actions dropdown and select the file type you need. SRT is a widely supported format (including Facebook video). Google makes it tricky to save the subtitles from other peoples' videos, but there is a workaround.
There are other problems with YouTube's service. For one, there is no way to collaborate on the subtitles. Or maybe your videos are for a course you're producing and you don't want to put your files on YouTube. Or maybe you are Irish and YouTube just completely mangles your accent.
There are plenty of reasons why YouTube isn't always the right tool for the job. Let's look at how to generate subtitles and captions for any video.
Watson + Amara (Free/Paid)
You might have heard about IBM's Watson supercomputer when it was defeating defending Jeopardy! champions in 2011. IBM have put Watson technology to use processing all kinds of data, including speech. Simply upload an audio file to the speech-to-text demo and it will transcribe the audio for you.
Go ahead and jump to the app. Don't be fooled: the demo has plenty of functionality. I uploaded a six-minute audio clip and it was transcribed in just a few minutes.
I recommend transcription as a finishing step in editing a video. Lock down your edit, then export a WAV audio file from your video editor. If your app doesn't support exporting directly to WAV, I recommend you use Audacity to convert from other audio formats to WAV.
To upload audio, click on Select Audio File on the app page. Browse to your WAV file and choose it. Watson also supports Spanish, French, Portuguese and Japanese, so make sure and choose the language from the dropdown if it differs from English. Note: If you use an ad blocking plugin for your web browser, make sure and disable it for the IBM website. The demo might not function correctly if adblock is enabled.
A few minutes later, you'll have a transcription of the audio. At this stage, don't worry about correcting all of the incorrect words in the transcription. Copy the text from the transcription box and save it into a text file, using an app like Notepad on Windows or TextEdit on mac.
If you are a capable programmer, IBM offers a much more in-depth way to use the Watson technology. Check out IBM's tutorial on how to use the full Watson capabilities programmatically.
Use Amara to Create a Finished Subtitle File From Watson
Now you have a rough transcription of our audio. Next you'll synchronize it with the video.
For this step we'll use Amara, a service that's designed to do just that. Amara can help us generate a finished subtitle file that can be used on many different services. Jump over to Amara's site and sign up for a free account to get started.
After you've signed up for Amara, you'll need to link to your video file. Amara doesn't support uploading video directly to its site, so you'll need to get the file online first. I have an FTP server, so I'll often upload the video to my server and link to it. If you don't have a web server to use you can upload to Vimeo, for example, and use it as a temporary host.
Paste in a link to your video, hit Begin, and Amara will load the video into its subtitling system. Now it's time to upload the transcription Watson generated for us. Click on Upload them directly on the left side of the screen to upload the text file to Amara.
Once you click on the upload them directly option, you'll need to point Amara to the text file that we saved in the last step. Also, specify the language of the text and the video language. Once you press Upload, Amara will load the generated text.
Click on the language of the subtitle on the left side. Then press Edit Subtitles on the next screen to adjust the timings of your subtitles.
Check out the video below to walk through the time sync process:
You could create subtitles using Amara alone, but that requires typing the captions from scratch. IBM Watson gives us a great starting point, and pairs well with Amara to get the timing right.
One of the perks of using Amara is that it's great for collaboration and translation. If you have a skilled translator, they can just as easily link to your video and generate subtitles in a different language.
Descript (Subscription)
Descript is a relatively new tool and takes a really refreshing approach to edit audio and create transcripts, all in one package. It features a really slick interface and desktop apps.
A free account unlocks three hours of audio processing. To start with it, I created an account, then opened an audio file in the app.
After a few minutes, Descript generated captions as accurate as any tool I've tried. Here's the magic: your transcribed audio appears just like a document. You can scroll and review your take easily using the efficient interface.
But while you're reviewing (and adjusting) your transcription, you can also edit and adjust your audio on the timeline. And notice those beautiful text annotations on top of the waveform!
Past tools always felt like choosing between text-centric and audio-centric tools. But with Descript, it feels like a "best of both worlds" where you can think in audio and see the text output.
Because Descript has built-in recording tools, you could actually use it as a fully-featured recording center. Imagine using it to create a podcast and export a finished file that includes a ready-to-share transcript.
When you're finished, you can export a subtitle file or jump directly to the video editing tool of your choice.
Descript is an interesting video tool, with a unique and efficient interface to edit video based on the automatically transcribed audio.
Kapwing (Subscription)
Kapwing is a browser-based video editor with a speech-to-text subtitling tool that's very easy to use, and creates automatic transaltions, too. We are testing the results, and so far they are impressive. It's the newest entry on this list, but probably the best option if you are someone who needs to make captions and subtitles for social media videos as it integrates well with online services.
Accessibility is Good for Everyone
With the rise of multiple online video platforms and the spread of video-capable smartphones we're now producing and using more and more video every day. This swell of video creates three new access problems:
- How do we find the videos we want in a crowded world?
- How do you watch all these new videos if you have a hearing impairment?
- How do you follow along with video that isn't in your first language, as is now an everyday reality for millions of people?
Subtitles and captions solve all of these problems.
Search engines have no idea what's in your videos. This is slowly changing with the rise of algorithms that can interpret images but, fundamentally, search engines are built to read text. The best way to tell the world what's in your video is still to describe it. Subtitles and closed captions provide exactly the kind of juicy text information that Google and the rest love to have.
As many as 15 percent of Americans have a hearing impairment. Closed captions, or written text overlaid on a video that replicates what the speaker is saying, are a key accessibility tool. Accessibility is essential in all kinds of videos, but it's especially important when teaching with video, which is why Envato is moving towards providing captions on as many Tuts+ videos as we possibly can.
It's not just us, either: in the USA, significantly more closed captioning will be required by law by next year. It's also worth noting that Facebook videos play automatically, but they play silently by default, so if you want everyone on Facebook to know what people in your videos are saying you really need captions or subtitles.
Subtitles are frequently used as a way to translate language from one medium to another (such as spoken English to written English) or one language to another. They're a great way to make video more accessible to diverse linguistic audiences.
Learn Video Editing
We've built a complete guide to help you learn how to edit videos, whether you're just getting started with the basics or you want to master video editing and post-production. Also check out the time-saving video templates on Envato Elements, learn how to plan your video projects, and discover the best video editing software. More resources below:
iMovie vs Final Cut Pro: What's the Best Video macOS App for Your Needs?
Video Editing Software Compared: Apple's Final Cut Pro X vs Adobe's Premiere Pro
Adobe Rush or Adobe Premiere: Which Video Editing Tool Is Right for You?
After Effects vs Premiere Pro: for Motion Graphics and Video Editing
And if you're looking for some free B-roll to use in your next video, try the huge collection on Mixkit. Browse the growing library of free HD video, and sign up to see the brand new videos that are added each week.
