Speech-to-Text for Video and Audio Assets

Summary

Bynder can automatically generate transcripts for audio and video assets in your Bynder DAM via Speech-to-Text. This feature automatically converts audio content for multiple languages into text (transcriptions), making these assets easily searchable. Users can locate keywords or phrases in videos and audio files without manually adding individual tags. Clicking a word in the generated transcript will play the media from that specific location. In addition, you can improve the accessibility of your content by adding closed captions to your videos. Bynder also enables users to do in-line editing of transcripts for maximum accuracy.

Who?

This feature/solution requires your Customer Success Contact to enable, but then individual permissions can be done by the Bynder Admin.

Don't yet have Bynder? Start Here!

Once enabled users with the edit assets permission can edit speech-to-text. 

How?

Viewing and Editing Transcripts

The subtitles will be displayed within Bynder only. Subtitles will not appear for assets embedded outside of Bynder or in any other Bynder solutions. 

  1. Navigate to your Portal and select the Assets tab.

  2. Use the search bar to locate your video or audio file. 

    speech-to-text-results.png
  3. Select and open the video.

  4. Select Transcript in the Asset Detail View. 

    Screenshot 2023-11-17 at 3.33.33 PM.png
  5. A new window will pop up where you can view the transcription text. Clicking on a word in the transcript will bring you to the exact location in the video. Screenshot 2023-11-17 at 3.35.46 PM.png

  6. To edit the transcript inline for accuracy, double-click the word you wish to change (requires edit permissions).

Downloading Transcripts

You will see two tabs in the transcript window: the Transcript tab and the Details tab.

  • Details Tab: View the date generated, media length, language, word count, and confidence score. 

  • Transcript Tab: View the text and timings. Click on your preferred file format (SRT, VTT, or TXT) at the top to download the transcript to your local device. 

    Screenshot_Transcript.png

If your portal has Bynder's AI Search, AI-Speech-to-text solution enabled, you can automatically transcribe video audio and convert it to subtitles. To learn how to apply your downloaded subtitle files to a video player, read our How To Use And Understand Adaptive Video Streaming.

Supported Languages

Speech-to-Text offers support for 100 languages, with the following as the most common. If the language you're interested in is not included in the list, please reach out to your Customer Success Contact to verify its support status.

Arabic, Modern Standard Japanese
Belarusian Korean
Bosnian Latvian
Bulgarian Lithuanian
Catalan Macedonian
Chinese, Simplified Malay
Chinese, Traditional Norwegian Bokmål
Croatian Polish
Czech Portuguese
Danish Portuguese, Brazilian
Dutch Romanian
English Russian
Estonian Serbian
Finnish Slovak
French Slovenian
German Spanish
Greek Tagalog/Filipino
Hebrew Tamil
Hindi, Indian Thai
Hungarian Turkish
Icelandic Vietnamese
Indonesian  
Italian  

File Restrictions

The following files cannot be transcribed:

  • Files larger than 2GB
  • Files longer than 4 hours
  • Files shorter than 3 seconds

Confidence Score

Transcripts will not be shown if their confidence score is less than 50 out of 100

A confidence score indicates the accuracy of a transcript. See below for some of the factors that can affect the confidence score:

  • Audio Quality: The audio input quality can significantly affect the confidence score. Clear, noise-free audio produces higher confidence, while poor quality or loud background audio results in lower scores.
  • Speaker Variability: If multiple speakers are in the audio, this can lower the confidence score, as distinguishing between different voices can be challenging.
    • Currently, single-language identification is supported. The predominant language will be transcribed if two languages are spoken in the media.
  • Language Complexity: Complex vocabulary, accents, and dialects can impact the confidence score. Uncommon or technical terms may lead to lower scores.

Related Articles

 

Updated