Home | Help Center

Endless possibilities in academia

Online recognition method for walking patterns of intelligent knee prostheses based on CNN-LSTM algorithm

Yibin Zhang1, Yan Wang1, Hongliu Yu2
1School of Medical Devices, Shanghai University of Medicine and Health Sciences, Shanghai 201318, China. 2School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China.


Address correspondence to: Hongliu Yu, School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai city Jungong road 516, Shanghai 200093, China. E-mail: yhl98@hotmail.com.


DOI:https://doi.org/10.61189/961030gznunx


Received June 21, 2024; Accepted November 20, 2024; Published December 31, 2024


Highlights

● In prosthetics, using AI algorithms to identify the fused sensor data as known walking patterns has extremely strong expandability. Moreover, as the learning data continues to expand, the robustness of the model itself also increases accordingly.
● There are numerous AI algorithms currently available. The effective utilization of algorithm combination techniques to learn from each other’s strengths can significantly improve the accuracy of identification. The combined model of convolutional neural networks (CNN) and bidirectional long short term memory (LSTM) attempted in this paper has witnessed a significant improvement in its comprehensive recognition rate.
● In the practical application of prosthetics, the real-time performance during the mode switching transition period is particularly important as it can reflect the flexibility of the prosthetics. In this paper, the algorithm optimized by the AI model has controlled the delay rate within one gait cycle, greatly enhancing the safety and reliability of pro-sthetics in actual use.

Abstract

To enhance the adaptive learning, self-organization, and fault tolerance capabilities of gait pattern recognition in intelligent knee prostheses, an online walking pattern recognition method based on the convolutional neural networks (CNN)-long short term memory (LSTM) model is proposed. Five test subjects wore the intelligent knee prostheses and performed four walking modes: level walking, uphill walking, downhill walking, and stair descent. The preprocessed gait data were fed into four neural network models: CNN, LSTM, CNN-LSTM, and CNN-bidirectional LSTM. Through hyperparameter tuning, the recognition accuracy of these models was compared. Real-time indicator, gait recognition delay, was also measured. Experimental results showed each model had its strengths and weaknesses. Overall, the CNN-LSTM model achieved the best recognition performance with accuracy rates of: level walking 89%±2.5%, uphill 72.8%±3.2%, downhill 71%±3.2%, and stair descent 96%±2.5%. When switching from level walking to downhill, gait recognition delay was 51.7%±15.6%, and vice versa it was 75.8%±11.5%; when switching from level walking to stair descent, gait recognition delay was 47.1%±17.1%, and vice versa it was 38.6%±10.5%. In summary, the application of the CNN-LSTM model for walking pattern recognition in unilateral intelligent knee prostheses is feasible, with accuracy and real-time performance meeting the control requirements of the prostheses.

Keywords: Neural network, walking pattern, gait recognition, recognition delay rate

Zhang YB, Wang Y, Yu HL. Online recognition method for walking patterns of intelligent knee prostheses based on CNN-LSTM algorithm. Prog in Med Devices. 2024 Dec;2(4):145-153. doi:10.61189/961030gznunx.

Copy