Seamless Communication
A significant step towards removing language barriers through expressive, fast and high-quality AI translation.
- Paper • 2312.05187 • Published • 8
facebook/seamless-m4t-v2-large
Automatic Speech Recognition • Updated • 277k • 509Note SemalessM4T v2, an updated version with our novel UnitY2 architecture. This new model improves over SeamlessM4T v1 in quality as well as inference latency in speech generation tasks.
- Running on T4477📞
Seamless M4T v2
facebook/seamless-expressive
Text-to-Speech • Updated • 155Note SeamlessExpressive is a speech-to-speech translation model that captures certain underexplored aspects of prosody such as speech rate and pauses, while preserving the style of one's voice and high content translation quality.
facebook/seamless-streaming
Text-to-Speech • Updated • 150Note SeamlessStreaming is a streaming translation model. The model supports speech as input modality and speech/text as output modalities.
- Running on T4181📞
Seamless Streaming
facebook/w2v-bert-2.0
Feature Extraction • Updated • 216k • 108- Running on T4888📞
Seamless M4T
facebook/hf-seamless-m4t-large
Text-to-Speech • Updated • 4.62k • 50Note A 2.3B version designed for speech-to-speech translation (S2ST), speech-to-text translation (S2TT), text-to-speech translation (T2ST), text-to-text translation (T2TT) and automatic speech recognition (ASR). Transformers implementation of SeamlessM4T-large
facebook/hf-seamless-m4t-medium
Text-to-Speech • Updated • 9.29k • 24Note A 1.2B version also designed for S2ST, S2TT, T2ST, T2TT and ASR. Transformers implementation of SeamlessM4T-medium
facebook/seamless-m4t-large
Automatic Speech Recognition • Updated • 491Note A 2.3B version designed for speech-to-speech translation (S2ST), speech-to-text translation (S2TT), text-to-speech translation (T2ST), text-to-text translation (T2TT) and automatic speech recognition (ASR).
facebook/seamless-m4t-medium
Automatic Speech Recognition • Updated • 120Note A 1.2B version also designed for S2ST, S2TT, T2ST, T2TT and ASR.
facebook/seamless-m4t-unity-small-s2t
Updated • 22Note Designed for on-device inference (S2TT, S2ST, ASR).
facebook/seamless-m4t-unity-small
Updated • 21Note Designed for on-device inference (S2TT, ASR).
facebook/seamless-m4t-vocoder
Updated • 7