2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

Technical Program

Paper Detail

Paper IDASPS-6.4
Paper Title WIFI-BASED DEVICE-FREE GESTURE RECOGNITION THROUGH-THE-WALL
Authors Sai Deepika Regani, Beibei Wang, K.J. Ray Liu, University of Maryland, College Park, United States
SessionASPS-6: Sensing & Sensor Processing
LocationGather.Town
Session Time:Thursday, 10 June, 16:30 - 17:15
Presentation Time:Thursday, 10 June, 16:30 - 17:15
Presentation Poster
Topic Applied Signal Processing Systems: Signal Processing Systems [DIS-EMSA]
IEEE Xplore Open Preview  Click here to view in IEEE Xplore
Virtual Presentation  Click here to watch in the Virtual Conference
Abstract Device-free (passive) gesture recognition offers an enormous potential to simplify Human-Computer Interaction (HCI) in future smart environments. WIFI-based gesture recognition approaches have attained acclaim amongst others due to the omnipresence, privacy-preservation, and broad coverage of WIFI. However, there is no universal solution built on off-the-shelf devices that can accommodate an expandable set of gestures in a through-the-wall setting. In this work, we propose such a gesture recognition system that can recover information about the actual trajectory of the hand movement allowing an expandable set of gestures. Further, we leverage the rich multipath in a through-the-wall setting to develop a statistical model for the channel variations induced by a hand gesture. This model is used to derive a correspondence between the relative distance moved by the hand and the Time Reversal Resonating Strength (TRRS) decay. Based on this relation and the geometry of the gesture shape, we design feature extraction modules to enable gesture classification. We built a prototype of the proposed system on off-the-shelf WIFI devices and achieved a classification accuracy of 87% on a set of 6 uppercase English alphabets.