AVHuBERT<T> |
AV-HuBERT: a Transformer over fused audio and lip-video features, pre-trained by masked multimodal cluster prediction, with a CTC projection for recognition from audio, lips or both. |
AWSTranscribe<T> |
An Amazon Transcribe stand-in: a streaming Conformer transducer, since Amazon has not disclosed Transcribe’s architecture. |
AssemblyAIUniversal2<T> |
AssemblyAI Universal-2: a 600M-parameter Conformer RNN-T, the configuration of Universal-1 (Ramirez et al. |
AudioPaLM<T> |
AudioPaLM’s speech recognition (Rubenstein et al. |
AzureSpeechSTT<T> |
Azure Speech’s nearest disclosed recognizer: Microsoft’s streaming Conformer transducer (Chen et al. |
BESTRQ<T> |
BEST-RQ: a Conformer speech encoder pre-trained to predict the labels a fixed random-projection quantizer assigns to the masked input, with a CTC layer for recognition. |
Branchformer<T> |
Branchformer (Peng et al. |
CIFDecoder<T> |
The CIF-based recognizer of Dong and Xu (2020): continuous integrate-and-fire between a self-attention encoder and a non-autoregressive decoder. |
CIFEncoder<T> |
CIF (Continuous Integrate-and-Fire) encoder for soft monotonic alignment in ASR. |
CTCSegmentation<T> |
CTC-segmentation (Kurzinger et al. |
CanaryFlash<T> |
Canary-1B-Flash: NVIDIA’s Canary (Puvvada et al. |
CanaryQwen<T> |
Canary-Qwen-2.5B (NVIDIA, 2025): a speech-augmented language model (SALM, Chen et al. |
Chirp2<T> |
Chirp 2: Google Cloud’s second-generation Chirp recognizer, a USM-family Conformer with a CTC layer. |
Chirp3<T> |
Chirp 3: Google Cloud’s third-generation Chirp recognizer, a USM-family Conformer with a CTC layer. |
Chirp<T> |
Chirp: Google Cloud’s first-generation Chirp recognizer, the 2B-parameter Universal Speech Model (USM) with a CTC layer, served through Speech-to-Text V2. |
CodeSwitchingASR<T> |
Code-switching ASR: a hybrid CTC/attention model trained jointly with an EXPLICIT language-identification task, for speech that mixes languages inside one utterance. |
ConformerCTC<T> |
Conformer-CTC: the Conformer encoder (Gulati et al. |
ConformerTransducer<T> |
Conformer-Transducer (Gulati et al. |
ContextNet<T> |
ContextNet: CNN encoder with squeeze-and-excitation and global context for ASR. |
ConvTransformer<T> |
Transformers with convolutional context (Mohamed et al. |
Data2VecASR<T> |
Data2Vec ASR: general-purpose self-supervised learning |
DeepgramNova2<T> |
A Deepgram Nova-2 stand-in: a Transformer encoder with a CTC layer, since Deepgram has disclosed only that Nova-2 is a Transformer-based end-to-end model. |
DistilWhisper<T> |
Distil-Whisper (Gandhi et al. |
EBranchformer<T> |
E-Branchformer (Kim et al. |
ESPnetASR<T> |
ESPnet ASR (Watanabe et al. |
EfficientConformer<T> |
Efficient Conformer with progressive temporal downsampling and grouped attention. |
EmformerRNNT<T> |
Emformer RNN-T (Shi et al. |
FastEmit<T> |
FastEmit (Yu et al. |
FasterWhisper<T> |
faster-whisper: SYSTRAN’s CTranslate2 inference engine for Whisper checkpoints, here at large-v3. |
FireRedASRLLM<T> |
FireRedASR-LLM (FireRed Team, 2025): the Encoder-Adapter-LLM recognizer of FireRedASR, which feeds the FireRedASR-AED Conformer encoder’s output through an adapter into Qwen2-7B-Instruct. |
FireRedASR<T> |
FireRedASR-AED (Xu et al. |
FunASRNano<T> |
Fun-ASR-nano (Tongyi Lab, 2025): an LLM-based recognizer of a SenseVoice-Small audio encoder, a Transformer adaptor and the Qwen3-0.6B decoder, with a CTC decoder whose first-pass hypothesis drives hotword retrieval. |
GladiaASR<T> |
Gladia’s speech-to-text: a hosted recognizer built on Whisper large-v3. |
GoogleSpeechV2<T> |
Google Cloud Speech-to-Text V2: Google’s hosted recognizer, served on its Chirp models, which are the Universal Speech Model (USM) with a CTC layer. |
GraniteSpeech<T> |
Granite-speech (Saon et al., IBM 2025): a conformer CTC acoustic encoder, a window Q-Former speech modality adapter and a Granite LLM with LoRA adapters, which writes the transcript of the audio it is given in its chat prompt. |
GroqWhisper<T> |
Groq’s hosted Whisper: openai-whisper large-v3 served on Groq’s inference hardware. |
HuBERTASR<T> |
HuBERT ASR: Hidden-Unit BERT for self-supervised speech representation |
InterCTC<T> |
InterCTC (Lee and Watanabe 2021): a CTC encoder regularized by a second CTC loss on its middle layer. |
KeywordSpotting<T> |
Keyword Spotting: lightweight wake-word and command detection |
KotobaWhisper<T> |
Kotoba-Whisper: Distil-Whisper’s recipe applied to Japanese, a large-v3 encoder with a 2-layer decoder. |
MMS<T> |
MMS: Massively Multilingual Speech covering 1100+ languages |
MedicalASR<T> |
Medical-conversation ASR: Chiu et al. |
MoonshineBase<T> |
Moonshine Base (Jeffries et al. |
Moonshine<T> |
Moonshine Tiny (Jeffries et al. |
Moshi<T> |
Moshi’s streaming speech recognizer (Défossez et al. |
NeMoCitrinet<T> |
NeMo Citrinet: 1D time-channel separable convolution CTC model with squeeze-and-excitation. |
NeMoMultitask<T> |
NeMo’s multitask attention encoder-decoder, Canary-1B (Puvvada et al. |
NemotronSpeech<T> |
Nemotron Speech Streaming: NVIDIA’s cache-aware Fast Conformer (Noroozi et al. |
NoiseRobustASR<T> |
Noise-robust speech recognition as Whisper (Radford et al. |
OLMoASR<T> |
OLMoASR (Ngo et al., Ai2 2025): Whisper’s encoder-decoder, with Whisper’s English-only tokenizer, trained from scratch on the curated open OLMoASR-Mix. |
OWSM<T> |
OWSM v3.1 (Peng et al. |
OmnilangualASR<T> |
Omnilingual ASR’s CTC recognizer: a wav2vec 2.0 encoder over the raw waveform with a single linear CTC layer. |
ParaformerLarge<T> |
Paraformer-large (Gao et al. |
Paraformer<T> |
Paraformer (Gao et al. |
ParakeetCTC<T> |
Parakeet-CTC: NVIDIA NeMo’s Fast Conformer (Rekesh et al. |
ParakeetRNNT<T> |
Parakeet-RNNT: NVIDIA NeMo’s Fast Conformer (Rekesh et al. |
ParakeetTDT<T> |
Parakeet-TDT: NVIDIA NeMo’s Fast Conformer with a token-and-duration transducer (Xu et al. |
Phi4Audio<T> |
Phi-4-multimodal’s speech recognition (Abdin et al., Microsoft 2025): a conformer audio encoder and a projector that feed Phi-4-Mini, which carries the speech LoRA adapters (“Mixture of LoRAs”) and writes the transcript. |
Qwen3ASRSmall<T> |
Qwen3-ASR-0.6B (Qwen Team, 2026): an LLM-based recognizer of the AuT audio encoder and the Qwen3-0.6B decoder, which names the language and then writes the transcript. |
Qwen3ASR<T> |
Qwen3-ASR-1.7B (Qwen Team, 2026): an LLM-based recognizer of the AuT audio encoder and the Qwen3-1.7B decoder, which names the language and then writes the transcript. |
RWKVTransducer<T> |
RWKV streaming transducer: a linear-attention encoder that is genuinely recurrent, so it streams without chunking or a growing cache. |
RevAI<T> |
Rev AI’s Reverb ASR (Rev 2024): the open-source engine behind Rev’s API, a WeNet joint CTC/attention Conformer with a bidirectional attention decoder. |
RobustConformer<T> |
Noise-robust wav2vec 2.0 (Wang et al. |
SALM<T> |
SALM (Chen et al., 2023): a speech-augmented language model that feeds a Fast Conformer encoder’s output through a Conformer modality adapter into a Megatron GPT with LoRA, for multitask speech recognition and translation with in-context le… |
SPIRAL<T> |
SPIRAL: a convolution-Transformer speech encoder pre-trained to make its representation of perturbed speech match a moving-average teacher’s representation of the clean speech, with a convolutional CTC classifier. |
SambaASR<T> |
Samba-ASR: Mamba-based state-space model for speech recognition |
SarvamASR<T> |
A Sarvam speech-to-text stand-in: a Conformer encoder with a CTC layer over Unicode characters of the Indic scripts, since Sarvam has not disclosed Saarika’s architecture. |
SeACo<T> |
SeACo-Paraformer (Shi et al. |
SeedASR<T> |
Seed-ASR (Bai et al., 2024): ByteDance’s audio-conditioned LLM recognizer, which feeds the LUISE Conformer encoder’s output through a frame-splicing converter into a large language model. |
SelfConditionedCTC<T> |
Self-conditioned CTC (Nozaki and Komatsu 2021): intermediate CTC predictions fed back into the encoder. |
SenseVoiceLarge<T> |
SenseVoice-Large (FunAudioLLM, 2024): an autoregressive encoder-decoder for multilingual recognition, language identification, speech emotion recognition and audio event detection, its tasks selected by decoder input tokens. |
SenseVoice<T> |
SenseVoice-Small (An et al. |
SpeakerDiarizedASR<T> |
Speaker-Diarized ASR: who-spoke-what transcription |
SpeechBrain<T> |
SpeechBrain ASR (Ravanelli et al. |
SpeechGPT<T> |
SpeechGPT’s speech recognition (Zhang et al. |
SpeechmaticsASR<T> |
A Speechmatics stand-in after Ursa’s disclosed design: an efficient Transformer encoder whose acoustic model gives phoneme probabilities, here a Conformer with a CTC layer over phonemes. |
Squeezeformer<T> |
Squeezeformer speech recognition model with temporal U-Net structure. |
StreamingConformer<T> |
A streaming Conformer transducer: the Conformer of Gulati et al. |
StreamingZipformer<T> |
Streaming Zipformer (Yao et al. |
TDTDecoder<T> |
Token-and-Duration Transducer (Xu et al. |
USM<T> |
Google USM’s CTC recognizer (USM-CTC): a 2B-parameter Conformer pre-trained with BEST-RQ, with a projection and a CTC layer. |
UniSpeech<T> |
UniSpeech: unified pre-training for speech representation learning |
VoxtLM<T> |
VoxtLM: one decoder-only language model for speech recognition, synthesis, and speech and text continuation (Maiti et al. |
WavLMASR<T> |
WavLM ASR: speech pre-training with denoising and attention |
WavLMRobust<T> |
WavLM-Robust: noise-robust speech recognition via denoising pre-training |
WhisperCPP<T> |
whisper.cpp: Georgi Gerganov’s C/C++ port of Whisper, here at the base checkpoint it ships by default. |
WhisperLargeV3Turbo<T> |
OpenAI’s Whisper large-v3-turbo: large-v3’s encoder with the decoder pruned to 4 layers and fine-tuned. |
WhisperLargeV3<T> |
OpenAI’s Whisper large-v3: a 1.55B-parameter encoder-decoder Transformer over 128-bin log-mel windows. |
WhisperLive<T> |
WhisperLive: Collabora’s near-real-time Whisper server, re-transcribing the growing audio buffer as chunks arrive. |
WhisperTimestamped<T> |
whisper-timestamped: Whisper with word timestamps by dynamic time warping over cross-attention. |
WhisperX<T> |
WhisperX (Bain et al. |
XLSR<T> |
XLS-R: cross-lingual speech representation at scale |