Resemble AI Launches Speech-to-Speech Feature to Capture the Unique Style of Human Voices at Scale

Share Article

With the launch of its new speech-to-speech feature, Resemble AI (https://www.resemble.ai/) is bringing natural-sounding AI voices to millions of developers and creators and continuing to expand the creative possibilities for human voices and beloved characters.

News Image
“Resemble AIʼs mission is to make interactions with digital products as human and natural as possible,” says Resemble AI founder & CEO Zohaib Ahmed. “Now, developers and storytellers can create content in any language and any voice, without the expense or travel associated with recording studios.”

Resemble AI today announced the launch of its speech-to-speech feature, to capture the unique style of human voices at scale and bring natural-sounding AI voices to millions of developers and creators across gaming, entertainment, e-learning, and more. Resemble AI’s generative audio continues to expand the creative possibilities for human voices and beloved characters.

Now AI voices can perform a wide range of emotions, speaking styles or even singing using non-speech vocalizations. If the input audio is spoken in a different language, the resulting target voice will be able to speak in that language. To see speech-to-speech in action, watch this video.

“We’re really happy with the quality of voices we’re able to develop for ‘Animals Anonymous’ using Resemble AI,” says Fika Agency co-founder Adam Altman. “Now our entire team can record new episodes that feel consistent with the same voices our listeners are used to hearing.”

The team at Resemble AI refined speech-to-speech when it used 3 minutes and 12 seconds of Andy Warhol’s original voice recordings from the 1970s and 80s to produce synthetic voice narration for the Emmy-nominated and Dorian Award-winning Netflix docu-series, The Andy Warhol Diaries. The team made adjustments for emotion and pitch to the AI output of Andy Warhol’s voice, and added human-like imperfections using reference audio clips of another speaker, as seen in this video about how Resemble AI's Style Transfer works.

“Resemble AIʼs mission is to make interactions with digital products as human and natural as possible,” says Resemble AI founder and CEO Zohaib Ahmed. “We’ve dramatically accelerated and simplified the process of creating human-like AI voices by building hyper realistic synthetic voices that can match or expand the reach of voice actors. This means that developers, creators and storytellers can create content in any language, and with any voice, without the need for expense or travel associated with recording studios.”

Starting today, Resemble AI customers on the Basic, Pro (new) and Enterprise plans will see a new option for speech-to-speech when creating a sentence in a clip within a project. Instead of using text as input, they can provide a spoken sentence by uploading a pre-recorded audio file or record directly through the interface. This enables high quality AI voices and allows the target voice to speak in a different language than the original voice–which must be the same voice that records a consent line at the start of any project.

Consent is a requirement for all Resemble AI projects and transparency is maintained throughout the process, as seen in this video about how Resemble AI voice cloning works. To learn more about how Resemble AI maintains ethical standards across the industry, visit https://www.resemble.ai/ethics/.

About Resemble AI
Resemble AI’s technology is being used by some of the largest media companies in the world to create content that was previously impossible. Whether it's transferring a voice into dozens of other languages,creating thousands of dynamic personalized messages from celebrities, or creating unique real-time conversational agents, Resemble AI is changing how content is created.

With Resemble AI, creating engaging and high-quality voice content is now easier than ever, enabling content creators to add a whole new level of authenticity to their work, and will add a new level of immersion for the audience. Learn more at https://www.resemble.ai/our-solution/.

Share article on social media or email:

View article via:

Pdf Print

Contact Author

Amy Jackson