Continuous gesture prediction and recognition using GMM-HMMs and Viterbi backtracking with sEMG
Author:
Affiliation:

1.Liming Vocational University;2.Quanzhou Institute of Equipment Manufacturing Haixi Institutes, Chinese Academy of Science

  • Article
  • | |
  • Metrics
  • |
  • Reference [18]
  • | |
  • Cited by
  • | |
  • Comments
    Abstract:

    Addressing the issues of poor real-time performance and insufficient predictive capability in continuous gesture recognition tasks based on surface electromyography (sEMG), a method utilizing Gaussian Mixture Model-Hidden Markov Models (GMM-HMMs) and Viterbi traceback is proposed for continuous gesture recognition. This approach leverages Gaussian Mixture Models-Hidden Markov Models (GMM-HMMs) to classify hand gestures into idle, ascending, steady, and descending states. A refined Viterbi sliding window marginalization technique is implemented to ensure prolonged connections between adjacent windows, enabling anticipatory prediction of subsequent gesture states. Moreover, a dynamic threshold model based on maximum likelihood is incorporated to accurately categorize gestures. In a study where 8 participants performed 12 continuous dual-gesture tasks, the method proposed attained an average recognition rate of 98.1% with a prediction time of 71ms, surpassing the LSTM model (94.2%, 309ms) and the GRU model (93.8%, 300ms), resulting in a considerable decrease in prediction time.

    Reference
    [1] 丁其川, 熊安斌, 赵新刚, 等. 基于表面肌电的运动意图识别方法研究及应用综述[J]. 自动化学报, 2016, 42(1): 13-25.
    [2] GAO Z, TANG R, HUANG Q, et al. A Multi-dof Prosthetic Hand Finger Joint Controller for Wearable semg Sensors by Nonlinear Autoregressive Exogenous Model[J]. Sensors, 2021, 21(8): 2576.
    [3] KERDJIDJ O, AMARA K, HARIZI F, et al. Implementing hand gesture recognition using EMG on the Zynq circuit[J]. IEEE Sensors Journal, 2023, 23(9): 10054-10061.
    [4] TRIGILI E, GRAZI L, CREA S, et al. Detection of movement onset using EMG signals for upper-limb exoskeletons in reaching tasks[J]. Journal of NeuroEngineering and Rehabilitation, 2019, 16(1): 45.
    [5] LI K, ZHANG J, WANG L, et al. A review of the key technologies for sEMG-based human-robot interaction systems[J]. Biomedical Signal Processing and Control, 2020, 62: 102074.
    [6] WANG S, HUANG L, JIANG D, et al. Improved multi-stream convolutional block attention module for sEMG-based gesture recognition[J]. Frontiers in Bioengineering and Biotechnology, 2022, 10.
    [7] WANG Y, WU Q, DEY N, et al. Deep back propagation–long short-term memory network based upper-limb sEMG signal classification for automated rehabilitation[J]. Biocybernetics and Biomedical Engineering, 2020, 40(3): 987-1001.
    [8] TORO-OSSABA A, JARAMILLO-TIGREROS J, TEJADA J C, et al. LSTM recurrent neural network for hand gesture recognition using EMG signals[J]. Applied Sciences, 2022, 12(19): 9700s
    [9] 丁其川, 赵新刚, 李自由, 等. 基于自更新混合分类模型的肌电运动识别方法[J]. 自动化学报, 2019, 45(8): 1464-1474.
    [10] YANG J, PAN J, LI J. sEMG-based continuous hand gesture recognition using GMM-HMM and threshold model[C]//2017 IEEE International Conference on Robotics and Biomimetics (ROBIO). Macau: IEEE, 2017: 1509-1514.
    [11] ZHANG Z, HE C, YANG K. A novel surface electromyographic signal-based hand gesture prediction using a recurrent neural network[J]. Sensors, 2020, 20(14): 3994.
    [12] KIM E, SHIN J, KWON Y, et al. EMG-based dynamic hand gesture recognition using edge AI for human–robot interaction[J]. Electronics, 2023, 12(7): 1541.
    [13] WU L, CHEN X, CHEN X, et al. Rejecting novel motions in high-density myoelectric pattern recognition using hybrid neural networks[J]. Frontiers in Neurorobotics, 2022, 16: 862193.
    [14] XIONG D, ZHANG D, ZHAO X, et al. Deep learning for EMG-based human-machine interaction: a review[J]. IEEE/CAA Journal of Automatica Sinica, 2021, 8(3): 512-533.
    [15] YU B, ZHANG X, WU L, et al. A novel postprocessing method for robust myoelectric pattern-recognition control through movement pattern transition detection[J]. IEEE Transactions on Human-Machine Systems, 2020, 50(1): 32-41.
    [16] CHEN Y, ZHANG H, WANG C, et al. A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention[J]. Scientific Reports, 2023, 13(1): 4730.
    [17] ZHENG K, LIU S, YANG J, et al. sEMG-based continuous hand action prediction by using key state transition and model pruning[J]. Sensors, 2022, 22(24): 9949.
    [18] D'' ACCOLTI D, CLEMENTE F, MANNINI A, et al. Online classification of transient EMG patterns for the control of the wrist and hand in a transradial prosthesis[J]. IEEE Robotics and Automation Letters, 2023, 8(2): 1045-1052.
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation
Share
Article Metrics
  • Abstract:18
  • PDF: 0
  • HTML: 0
  • Cited by: 0
History
  • Received:September 05,2024
  • Revised:November 13,2024
  • Adopted:November 13,2024
Article QR Code

Address:No. 219, Ningliu Road, Nanjing, Jiangsu Province

Postcode:210044

Phone:025-58731025