Mistral AI's Voxtral Mini Transcribe 3 Claims Second Place on Voice Arena's Speaker Diarization and ASR Leaderboard
Voxtral Mini Transcribe 3 ranks #2 on Voice Arena’s Diarization + ASR leaderboard.
Context
Outperforming even its larger Voxtral Small sibling on held out multi speaker conversations with a strict zero millisecond collar shows that Mistral's compact audio model can deliver top tier transcription and speaker attribution at lower inference cost.
Following Mistral AI's release of the Voxtral 3 audio model family, the independent benchmark platform Voice Arena evaluated Voxtral Mini Transcribe 3 and Voxtral Small Transcribe 3 across 139 held out multi speaker conversations. Mistral AI highlighted the benchmark results on Wednesday morning after Voxtral Mini Transcribe 3 secured second place overall.
Deep dive
Mistral AI announced on Wednesday morning that its compact speech model, Voxtral Mini Transcribe 3, has ranked second overall out of nine frontier audio models on Voice Arena's joint Speaker Diarization and Automatic Speech Recognition leaderboard, edging out its larger sibling, Voxtral Small Transcribe 3.
According to Voice Arena's evaluation across 139 held out multi speaker conversations using human verified ground truth transcripts, Voxtral Mini Transcribe 3 achieved a 40.4 percent Diarization Error Rate to claim second place overall, while Voxtral Small Transcribe 3 posted a 41.1 percent Diarization Error Rate to finish fourth. All models were tested under identical unassisted conditions using a strict zero millisecond timing collar, with no predefined speaker counts and no pre processing audio cleanup.
The track breakdown shows complementary strengths between the two checkpoints: Voxtral Mini Transcribe 3 leads on in person multi speaker recordings with a 40.6 percent error rate compared with 41.5 percent for Small, whereas Voxtral Small Transcribe 3 performs slightly better on online meeting calls at 39.1 percent versus 39.5 percent. Both models accurately identified the exact number of speakers in 83.5 percent of all test sessions, with overlapping crosstalk accounting for the majority of remaining missed speech errors.
What to expect next
Accurate speaker diarization without pre specifying speaker counts or applying audio cleanup is essential for enterprise meeting transcription agents, clinical medical scribes, and customer support analytics. Because Voxtral Mini Transcribe 3 matches or beats larger models on in person multi speaker conversations while running at a smaller memory and compute footprint, expect rapid developer adoption across real time voice pipelines.