Topic:

mmWave Radar-based Hand Gesture Recognition using Range-Angle Image

 

Speaker:

曾柏軒 教授 Prof. Po-Hsuan Tseng

 

國立臺北科技大學電子工程系
Dept. of Electronic Engineering
National Taipei University of Technology

 

Language :

Chinese

 

Date:

2020/05/01

 

Time:

14:20~

 

Location: 

Delta building R216, NTHU

 

Abstract:

The radar sensing on fine human-motion/hand-gesture provides further human-
computer interaction (HCI) experience. Most of the studies about gesture recognition

with mmWave frequency modulated continuous wave (FMCW) radar adopts the range
and the velocity estimated from the raw data, such as the time-frequency spectrogram,
micro-doppler spectrogram, or range-Doppler image (RDI). Besides, the angle
estimated using multiple receive antennas also contains rich information of gesture,
especially in the discrimination among the horizontal movement of the gesture. Thus,
we propose to use the range-angle image (RAI) as the input and train a model consisting
of the convolutional neural network and long short term memory that is capable of
recognizing hand gestures. We validate the proposed scheme based on the collection of
hand gestures by several subjects in different classrooms using 77 - 81GHz mmWave
radar of Texas Instrument. Based on the configuration of one transmit antenna and four
receive antennas, we show that the hand gesture recognition using RAI outperforms
that using RDI. Also, we adopt the fusion strategy to consider both RDI and RAI to
further improve accuracy.

 

 

 

Short Bio: 

Po-Hsuan Tseng received the B.S. and Ph.D. degrees in communication engineering
from National Chiao Tung University, Hsinchu, Taiwan, in 2005 and 2011, respectively.
Since 2017, he has been an Associate Professor with the Department of Electronic
Engineering, National Taipei University of Technology (NTUT), Taipei, Taiwan,
where he was an Assistant Professor from 2012 to 2017. He has been serving as the
Vice Chairman with the Department of Electronic Engineering, NTUT since 2017. His
current research focuses on signal processing for networking and communications,
including wireless localization and sensing, networking for Internet of Things,
software-defined networks, and medical image analysis.