Wrist-Worn Hand Gesture Recognition

Date: 2022/09/30 - 2022/09/30

Academic Seminar: Wrist-Worn Hand Gesture Recognition

Speaker: Peter Shull, Shanghai Jiao Tong University in the School of Mechanical Engineering

Time: 10:00 - 11:30, September 30, 2022 (Beijing Time)

Location: via Tencent


Wrist-worn hand gesture recognition has wide-ranging potential to improve healthcare, enhance human computer interaction, and augment human communication. Hand gestures can connect human intention to immersive systems; hand movements are critical for upper extremity rehabilitation after stroke; and automatic hand gesture recognition can enable the hearing-impaired to communicate with individuals who do not understand sign language. This technical presentation will introduce and explore various approaches to wrist-worn hand gesture recognition including specific examples based on electromyography (EMG), force myography (FMG), inertial measurement units (IMU), and stretchable, e-skin sensing. This overview will serve to present the current state of wrist-worn hand gesture recognition research and offer potential avenues for further exploration.


Peter Shull is a Professor at Shanghai Jiao Tong University in the School of Mechanical Engineering. He received the Ph.D. degree in Mechanical Engineering from Stanford University in 2012, and the M.S. degree in Mechanical Engineering from Stanford University in 2008. His Ph.D. research on gait retraining for knee osteoarthritis received national attention as the feature article in the US National Science Foundation’s Science Nation. He was a postdoctoral research fellow in the Stanford Bioengineering Department focused on developing and validating a sensor embedded mouthguard for capturing head impact dynamics in professional American football to explore the mechanism of mild traumatic brain injury.

Peter Shull started the Wearable Systems Lab in 2013 at Shanghai Jiao Tong University. In 2015, his lab first demonstrated the feasibility of wrist-worn EMG sensing for automated hand gesture recognition, paving the way for future commercialization. The focus of the Wearable Systems Lab is to explore principles of human movement and movement modification to enable more immersive and natural human computer interaction. The lab combines artificial intelligence, biomechanics, and creative design principles to create unique wearable sensors and sensor combination approaches to improve medicine, entertainment, and athletics. Dr. Shull has received 17 competitive research grants, published 73 peer-review journal and conference articles, and delivered 52 academic technical presentations in English and Chinese. He has served as the primary academic advisor for 23 masters, doctoral, and postdoctoral researchers. In 2017, Dr. Shull received the US NIH National Center for Simulation in Rehabilitation Research Outstanding Researcher Award, and he currently serves as an Associate Editor for Nature npj Digital Medicine, IEEE Journal of Biomedical and Health Informatics, IEEE Transactions on Neural Engineering and Rehabilitation, and Wearable Technologies.