2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

Technical Program

Paper Detail

Paper IDAUD-22.2
Paper Title EFFICIENT END-TO-END AUDIO EMBEDDINGS GENERATION FOR AUDIO CLASSIFICATION ON TARGET APPLICATIONS
Authors Paulo Lopez-Meyer, Juan A. Del Hoyo Ontiveros, Hong Lu, Georg Stemmer, Intel Corporation, Mexico
SessionAUD-22: Detection and Classification of Acoustic Scenes and Events 3: Multimodal Scenes and Events
LocationGather.Town
Session Time:Thursday, 10 June, 15:30 - 16:15
Presentation Time:Thursday, 10 June, 15:30 - 16:15
Presentation Poster
Topic Audio and Acoustic Signal Processing: [AUD-CLAS] Detection and Classification of Acoustic Scenes and Events
IEEE Xplore Open Preview  Click here to view in IEEE Xplore
Virtual Presentation  Click here to watch in the Virtual Conference
Abstract We describe a general-purpose end-to-end audio embeddings generator that can be easily adapted to various acoustic scene and event classification applications. In contrast to many other models for audio classification, this end-to-end embeddings generator does not require a separate feature extraction step, but processes audio samples directly which simplifies its porting into hardware platforms. Our approach learns a generic audio embedding representation that is pre-trained on a large audio dataset. It can then be fine-tuned via transfer learning with limited data requirements for an audio classification target application. We compare different transfer learning strategies and evaluate the proposed embeddings generator on three popular publicly available datasets, and report results for different model sizes. The experimental results show that this end-to-end approach presents a scalable, efficient, and competitive alternative to more common spectral-based audio classifiers.