Paper ID | AUD-22.2 |
Paper Title |
EFFICIENT END-TO-END AUDIO EMBEDDINGS GENERATION FOR AUDIO CLASSIFICATION ON TARGET APPLICATIONS |
Authors |
Paulo Lopez-Meyer, Juan A. Del Hoyo Ontiveros, Hong Lu, Georg Stemmer, Intel Corporation, Mexico |
Session | AUD-22: Detection and Classification of Acoustic Scenes and Events 3: Multimodal Scenes and Events |
Location | Gather.Town |
Session Time: | Thursday, 10 June, 15:30 - 16:15 |
Presentation Time: | Thursday, 10 June, 15:30 - 16:15 |
Presentation |
Poster
|
Topic |
Audio and Acoustic Signal Processing: [AUD-CLAS] Detection and Classification of Acoustic Scenes and Events |
IEEE Xplore Open Preview |
Click here to view in IEEE Xplore |
Virtual Presentation |
Click here to watch in the Virtual Conference |
Abstract |
We describe a general-purpose end-to-end audio embeddings generator that can be easily adapted to various acoustic scene and event classification applications. In contrast to many other models for audio classification, this end-to-end embeddings generator does not require a separate feature extraction step, but processes audio samples directly which simplifies its porting into hardware platforms. Our approach learns a generic audio embedding representation that is pre-trained on a large audio dataset. It can then be fine-tuned via transfer learning with limited data requirements for an audio classification target application. We compare different transfer learning strategies and evaluate the proposed embeddings generator on three popular publicly available datasets, and report results for different model sizes. The experimental results show that this end-to-end approach presents a scalable, efficient, and competitive alternative to more common spectral-based audio classifiers. |