New AI system by Meta can translate up to 100 different languages. Details inside…

SeamlessM4T, an Artificial Intelligence (AI) system has been launched by Meta which can translate and transcribe almost 100 languages in both text and speech as part of its effort to create AI that can comprehend a variety of dialects, according to the sources.   The new translation dataset called SeamlessAlign will also be available to […]

Author
Sonia Dham
Follow us:

SeamlessM4T, an Artificial Intelligence (AI) system has been launched by Meta which can translate and transcribe almost 100 languages in both text and speech as part of its effort to create AI that can comprehend a variety of dialects, according to the sources.  

The new translation dataset called SeamlessAlign will also be available to the users on open source. According to official statement by Meta, SeamlessM4T will be notable breakthrough in the field of AI-powered speech-to-speech and speech-to-text.

According to the official blog post of Meta SeemlessM4T supports:

  • Speech recognition for nearly 100 languages
  • Speech-to-text translation for nearly 100 input and output languages
  • Speech-to-speech translation, supporting nearly 100 input languages and 36 (including English) output languages
  • Text-to-text translation for nearly 100 languages
  • Text-to-speech translation, supporting nearly 100 input languages and 35 (including English) output languages
  • According to Meta in a blog post shared with TechCrunch, “Our single model offers on-demand translations that help people who speak different languages to communicate more effectively.”

How SeamlessM4T system has been developed?

Meta’s blog post further says, “SeamlessM4T builds on advancements we and others have made over the years in the quest to create a universal translator. Last year, we released No Language Left Behind (NLLB), a text-to-text machine translation model that supports 200 languages, and has since been integrated into Wikipedia as one of the translation providers. We also shared a demo of our Universal Speech Translator, which was the first direct speech-to-speech translation system for Hokkien, a language without a widely used writing system. And earlier this year, we revealed Massively Multilingual Speech, which provides speech recognition, language identification and speech synthesis technology across more than 1,100 languages.”