TY - JOUR
T1 - Physics-informed Deep Learning for Musculoskeletal Modelling
T2 - Predicting Muscle Forces and Joint Kinematics from Surface EMG
AU - Zhang, Jie
AU - Zhao, Yihui
AU - Shone, Fergus
AU - Li, Zhenhong
AU - Frangi, Alejandro F.
AU - Xie, Sheng Quan
AU - Zhang, Zhi Qiang
N1 - Publisher Copyright:
Author
PY - 2022
Y1 - 2022
N2 - Musculoskeletal models have been widely used for detailed biomechanical analysis to characterise various functional impairments given their ability to estimate movement variables (i.e., muscle forces and joint moments) which cannot be readily measured in vivo. Physics-based computational neuromusculoskeletal models can interpret the dynamic interaction between neural drive to muscles, muscle dynamics, body and joint kinematics and kinetics. Still, such set of solutions suffers from slowness, especially for the complex models, hindering the utility in real-time applications. In recent years, data-driven methods have emerged as a promising alternative due to the benefits in speedy and simple implementation, but they cannot reflect the underlying neuromechanical processes. This paper proposes a physics-informed deep learning framework for musculoskeletal modelling, where physics-based domain knowledge is brought into the data-driven model as soft constraints to penalise/regularise the data-driven model. We use the synchronous muscle forces and joint kinematics prediction from surface electromyogram (sEMG) as the exemplar to illustrate the proposed framework. Convolutional neural network (CNN) is employed as the deep neural network to implement the proposed framework. Simultaneously, the physics law between muscle forces and joint kinematics is used the soft constraint. Experimental validations on two groups of data, including one benchmark dataset and one self-collected dataset from six healthy subjects, are performed. The experimental results demonstrate the effectiveness and robustness of the proposed framework.
AB - Musculoskeletal models have been widely used for detailed biomechanical analysis to characterise various functional impairments given their ability to estimate movement variables (i.e., muscle forces and joint moments) which cannot be readily measured in vivo. Physics-based computational neuromusculoskeletal models can interpret the dynamic interaction between neural drive to muscles, muscle dynamics, body and joint kinematics and kinetics. Still, such set of solutions suffers from slowness, especially for the complex models, hindering the utility in real-time applications. In recent years, data-driven methods have emerged as a promising alternative due to the benefits in speedy and simple implementation, but they cannot reflect the underlying neuromechanical processes. This paper proposes a physics-informed deep learning framework for musculoskeletal modelling, where physics-based domain knowledge is brought into the data-driven model as soft constraints to penalise/regularise the data-driven model. We use the synchronous muscle forces and joint kinematics prediction from surface electromyogram (sEMG) as the exemplar to illustrate the proposed framework. Convolutional neural network (CNN) is employed as the deep neural network to implement the proposed framework. Simultaneously, the physics law between muscle forces and joint kinematics is used the soft constraint. Experimental validations on two groups of data, including one benchmark dataset and one self-collected dataset from six healthy subjects, are performed. The experimental results demonstrate the effectiveness and robustness of the proposed framework.
KW - Convolutional neural networks
KW - Deep learning
KW - deep neural network
KW - Electromyography
KW - Kinematics
KW - muscle forces and joint kinematics prediction
KW - Muscles
KW - Musculoskeletal modelling
KW - Musculoskeletal system
KW - physics-based domain knowledge
KW - Predictive models
UR - http://www.scopus.com/inward/record.url?scp=85144770225&partnerID=8YFLogxK
U2 - 10.1109/TNSRE.2022.3226860
DO - 10.1109/TNSRE.2022.3226860
M3 - Article
AN - SCOPUS:85144770225
SP - 1
JO - IEEE Transactions on Neural Systems and Rehabilitation Engineering
JF - IEEE Transactions on Neural Systems and Rehabilitation Engineering
SN - 1534-4320
ER -