DUBAI, United Arab Emirates--(BUSINESS WIRE)--CAMB.AI, www.camb.ai, a pioneer in content localization, has open-sourced and released the world’s most capable synthetic speech emulator, MARS5. Able to accurately replicate performances in over 140 languages, it requires just a few seconds of audio and text input to capture even incredibly prosodic performance.
MARS5’s English-language model is now open-source on GitHub. CAMB.AI encourages the developer, artificial intelligence and research community to build and learn with what they’ve produced. The other 140+ languages are available on CAMB.AI’s proprietary platform, https://studio.camb.ai.
Co-founder and CTO Akshat Prakash explains, “The level of prosody and realism that MARS5 is able to capture, even with just a few seconds of input, is unprecedented. This is a mistral moment in speech.”
MARS5 combines a mistral-style autoregressive model with a novel non-autoregressive model to capture emotion, performance, and meaning, like never before. It performs well even in traditionally difficult scenarios like sports commentary, movies, and anime which closed-source and open-source TTS models aren’t able to capture well today.
View the official MARS5 release video here.
This breakthrough was achieved with the continued support of AWS for GPU compute resources and NVIDIA infrastructure. As an NVIDIA Inception member, CAMB.AI uses the Triton Inference Server to scale inference for its two models MARS and BOLI, serving millions of requests worldwide.
Internally, CAMB.AI uses MARS5, alongside its own proprietary translation model BOLI, for its core dubbing and translation functions. It can transform English performances into even low-resource languages like Icelandic, Swahili, and even some Indigenous dialects.
Dedicated to an open-source philosophy that encourages collaboration and innovation, Prakash believes that “CAMB.AI stands as a testament to genuine AI research happening beyond traditional hubs. Innovation need not know any one language, color, or geography. The future belongs to everyone.”
About CAMB.AI
CAMB.AI’s proprietary models—MARS for voice cloning and BOLI for translations—were built by an Interspeech-published technical team from Carnegie Mellon, Apple, and Amazon.
DubStudio, the company’s flagship platform, offers on-the-fly colloquial and contextual translations, zero-shot voice cloning, multi-speaker support, and accurate time-synched dubbing. On April 2, 2024, CAMB.AI became the first company to live dub professional soccer commentary into four languages.
CAMB.AI is partnered with Major League Soccer, Tennis Australia, Maple Leaf Sports & Entertainment, leading movie and music studios, and several government agencies.
