2021 IEEE International Conference on Acoustics, Speech and Signal Processing
6-11 June 2021 • Toronto, Ontario, Canada
Extracting Knowledge from Information
| Paper ID | SS-11.1 | ||
| Paper Title | COMPRESSING DEEP NEURAL NETWORKS FOR EFFICIENT SPEECH ENHANCEMENT | ||
| Authors | Ke Tan, DeLiang Wang, The Ohio State University, United States | ||
| Session | SS-11: On-device AI for Audio and Speech Applications | ||
| Location | Gather.Town | ||
| Session Time: | Thursday, 10 June, 14:00 - 14:45 | ||
| Presentation Time: | Thursday, 10 June, 14:00 - 14:45 | ||
| Presentation | Poster | ||
| Topic | Special Sessions: On-device AI for Audio and Speech Applications | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | The use of deep neural networks (DNNs) has dramatically improved the performance of speech enhancement in the past decade. However, a large DNN is typically required to achieve strong enhancement performance, and this kind of model is both computationally intensive and memory consuming. Hence it is difficult to deploy such DNNs on devices with limited hardware resources or in applications with strict latency requirements. In order to address this problem, we propose a model compression pipeline to reduce DNN size for speech enhancement, which is based on three kinds of techniques: sparse regularization, iterative pruning and clustering-based quantization. Evaluation results show that our approach substantially reduces the sizes of different DNNs without significantly affecting their enhancement performance. Moreover, we find that training and compressing a large DNN yields higher STOI and PESQ than directly training a small DNN that has a comparable size to the compressed DNN. This further suggests the benefits of using the proposed model compression approach. | ||