2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

Technical Program

Paper Detail

Paper IDMLSP-19.5
Paper Title RANDOM PROJECTION STREAMS FOR (WEIGHTED) NONNEGATIVE MATRIX FACTORIZATION
Authors Farouk Yahaya, Matthieu Puigt, Gilles Delmaire, Gilles Roussel, Univ. Littoral Côte d'Opale, France
SessionMLSP-19: Non-Negative Matrix Factorization
LocationGather.Town
Session Time:Wednesday, 09 June, 14:00 - 14:45
Presentation Time:Wednesday, 09 June, 14:00 - 14:45
Presentation Poster
Topic Machine Learning for Signal Processing: [MLR-MFC] Matrix factorizations/completion
IEEE Xplore Open Preview  Click here to view in IEEE Xplore
Virtual Presentation  Click here to watch in the Virtual Conference
Abstract Random projections recently became popular tools to process big data. When applied to Nonnegative Matrix Factorization (NMF), it was shown that, in practice, with the same compression level, structured random projections were more efficient than classical strategies based on, e.g., Gaussian compression. However, as they are data-dependent, they remain costly and might not fully benefit from recent very fast random projection techniques. In this paper, we thus investigate an alternative framework to structured random projections---named random projection streams (RPS)---which (i) are based on classical random compression strategies only---and are thus data-independent---and (ii) can benefit from the above fast techniques. We experimentally show that, under some mild conditions, RPS allow the same NMF performance as structured random projection along iterations. We also show that even a CPU implementation of Gaussian Compression Streams allows a faster convergence than structured random projections when applied to weighted NMF.