Topic
Speech & Audio
The latest AI xPress posts in Speech & Audio.
- A speech model pre-trained on unlabeled audio improved phoneme classification, speaker recognition, and spoken sentiment classification
In a 2020 paper from researchers at National Taiwan University, a speech model called Mockingjay improved performance on phoneme classification, speaker recognition, and sentiment classification of…
- A text-to-speech system showed no statistically significant difference from human recordings in a sentence-level test
In a 2024 paper in IEEE Transactions on Pattern Analysis and Machine Intelligence, researchers at Peking University, Microsoft Research Asia, Microsoft, and the University of Surrey describe a…
- Llama-AVSR reports a 0.77 percent word error rate on the LRS3 audio-visual speech benchmark
Researchers at Imperial College London, Meta, and Fondazione Bruno Kessler describe a model called Llama-AVSR that turns speech into text using sound and video of the speaker's lips. In a 2025 paper…
- Spoofed and deepfake speech detection held near earlier results in a harder challenge
In a 2021 paper, researchers describe ASVspoof 2021, the fourth edition of a challenge series that tests ways to protect voice-verification software, the kind of software that confirms who someone is…
- Challenge results suggest spoof and deepfake speech detectors stayed accurate under new transmission effects but did not generalize well across real rooms and online speech datasets
In a 2023 paper in IEEE/ACM Transactions on Audio Speech and Language Processing, researchers reported results from the ASVspoof 2021 challenge, which compares systems that detect spoofed and…
- A self-supervised speech emotion model outperformed both general and specialist recognizers after only linear-layer training
In a 2024 paper, researchers describe emotion2vec, a speech emotion representation model. The authors pre-trained the model on open-source unlabeled emotion data and then tested it on a mainstream…
- A redesigned speaker verification network significantly outperformed state-of-the-art TDNN-based systems on VoxCeleb test sets and the 2019 VoxCeleb Speaker Recognition Challenge
Speaker verification is the task of confirming that a voice recording belongs to the person who claims to be speaking. In a 2020 paper, researchers at Ghent University describe a network called…
- A speech model trained on 128 languages improved translation into English by an average of 7.4 BLEU over the previous best on the CoVoST-2 benchmark and cut speech recognition error rates by 14 to 34 percent relative to the best known prior work
In a 2022 paper published at Interspeech 2022, a peer-reviewed conference, researchers describe XLS-R, a self-supervised model for cross-lingual speech representation learning. They trained versions…
- A WavLM-based detector with a multi-fusion attentive classifier reported the strongest results on one audio-spoofing benchmark
In a 2024 paper, researchers at Zhejiang University reported that a detector pairing the WavLM speech model with a multi-fusion attentive classifier achieved the strongest results on the ASVspoof…
- A neural codec language model can synthesize high-quality personalized speech from a 3-second recording, peer-reviewed study reports
Researchers trained a neural codec language model called VALL-E to treat text-to-speech as a language prediction task over discrete speech codes, rather than as continuous signal regression. The…
