2021 IEEE International Conference on Acoustics, Speech and Signal Processing
6-11 June 2021 • Toronto, Ontario, Canada
Extracting Knowledge from Information
| Paper ID | IVMSP-15.1 | ||
| Paper Title | COMPRESSING LOCAL DESCRIPTOR MODELS FOR MOBILE APPLICATIONS | ||
| Authors | Roy Miles, Krystian Mikolajczyk, Imperial College London, United Kingdom | ||
| Session | IVMSP-15: Local Descriptors and Texture | ||
| Location | Gather.Town | ||
| Session Time: | Wednesday, 09 June, 15:30 - 16:15 | ||
| Presentation Time: | Wednesday, 09 June, 15:30 - 16:15 | ||
| Presentation | Poster | ||
| Topic | Image, Video, and Multidimensional Signal Processing: [IVELI] Electronic Imaging | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | Feature-based image matching has been significantly improved through the use of deep learning and new large datasets. However, there has been little work addressing the computational cost, model size, and matching accuracy tradeoffs for the state of the art models. In this paper, we consider these practical aspects and improve the state-of-the-art HardNet model through the use of depthwise separable layers and an efficient tensor decomposition. We propose the Convolution-Depthwise-Pointwise (CDP) layer, which partitions the weights into a low and full-rank decomposition to exploit the naturally emergent structure in the convolutional weights. We can achieve an 8× reduction in the number of parameters on the HardNet model, 13×reduction in the computational complexity, while sacrificing less than 1% on the overall accuracy across the HPatches benchmarks. To further demonstrate the generalisation of this approach, we apply it to other state-of-the-art descriptor models, where we are able to significantly reduce the number of parameters and floating-point operations. | ||