Paper ID | SPE-48.6 |
Paper Title |
ERROR-DRIVEN FIXED-BUDGET ASR PERSONALIZATION FOR ACCENTED SPEAKERS |
Authors |
Abhijeet Awasthi, Aman Kansal, Sunita Sarawagi, Preethi Jyothi, IIT Bombay, India |
Session | SPE-48: Speech Recognition 18: Low Resource ASR |
Location | Gather.Town |
Session Time: | Friday, 11 June, 11:30 - 12:15 |
Presentation Time: | Friday, 11 June, 11:30 - 12:15 |
Presentation |
Poster
|
Topic |
Speech Processing: [SPE-GASR] General Topics in Speech Recognition |
IEEE Xplore Open Preview |
Click here to view in IEEE Xplore |
Virtual Presentation |
Click here to watch in the Virtual Conference |
Abstract |
We consider the task of personalizing ASR models while being constrained by a fixed budget on recording speaker specific utterances. Given a speaker and an ASR model, we propose a method of identifying sentences for which a speaker's utterances are likely to be harder for the given ASR model to recognize. We assume a tiny amount of speaker-specific data to learn phoneme-level error models which help us select such sentences. We show that speaker's utterances on the sentences selected using our error model indeed have larger error rates when compared to speaker's utterances on randomly selected sentences. We find that fine-tuning the ASR model on the sentence utterances selected with the help of error models yield higher WER improvements in comparison to fine-tuning on an equal number of randomly selected sentence utterances. Thus our method provides an efficient way of collecting speaker utterances under budget constraints for personalizing ASR models. |