Paper ID | SS-15.5 | ||
Paper Title | LATENT SPACE MOTION ANALYSIS FOR COLLABORATIVE INTELLIGENCE | ||
Authors | Mateen Ulhaq, Ivan Bajic, Simon Fraser University, Canada | ||
Session | SS-15: Signal Processing for Collaborative Intelligence | ||
Location | Gather.Town | ||
Session Time: | Friday, 11 June, 13:00 - 13:45 | ||
Presentation Time: | Friday, 11 June, 13:00 - 13:45 | ||
Presentation | Poster | ||
Topic | Special Sessions: Signal Processing for Collaborative Intelligence | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | When the input to a deep neural network (DNN) is a video signal, a sequence of feature tensors is produced at the intermediate layers of the model. If neighboring frames of the input video are related through motion, a natural question is, ``what is the relationship between the corresponding feature tensors?'' By analyzing the effect of common DNN operations on optical flow, we show that the motion present in each channel of a feature tensor is approximately equal to the scaled version of the input motion. The analysis is validated through experiments utilizing common motion models. |