基于多模态数据融合的脑性瘫痪儿童连续运动预测算法研究OA
Research on continuous motion prediction algorithm for children with cerebral palsy based on multimodal data fusion
目的 采用多模态数据融合与深度学习方法,精准预测脑性瘫痪(简称脑瘫)儿童的连续运动轨迹,为个性化康复训练及辅助设备设计提供支持.方法 整合表面肌电信号(surface electromyography,sEMG)与惯性测量单元(inertial measurement unit,IMU)数据,构建基于卷积神经网络(convolutional neural network,CNN)与长短期记忆网络(long short-term memory,LSTM)架构的连续运动预测模型.采集 5 例脑瘫儿童行走时下肢的sEMG数据与IMU数据,经去噪、归一化预处理后,通过CNN提取空间特征,借助LSTM捕捉时序依赖关系,构建膝关节角度预测模型.模型性能采用平均绝对误差(mean absolute error,MAE)和决定系数(R2)进行评估.结果 评估结果显示,该模型在脑瘫儿童步态轨迹预测中表现出较高准确性:MAE=0.083 7±0.012 8,R2=0.986 1±0.007 1.多模态数据融合与CNN-LSTM架构有效提升了模型预测性能,可精准捕捉脑瘫儿童的复杂运动模式.结论 构建的基于多模态数据融合与CNN-LSTM架构的运动预测模型为脑瘫儿童运动功能障碍的定量评估提供了新技术手段,尤其是在设计个性化康复方案和辅助设备方面具有潜在的应用价值.
Objective To accurately predict the continuous motion trajectories of children with cerebral palsy using multimodal data fusion and deep learning methods,and provide support for personalized rehabilitation training and the design of assistive devices.Methods By integrating surface electromyography(sEMG)and inertial measurement unit(IMU)data,a continuous motion prediction model based on a convolutional neural network(CNN)and long short-term memory(LSTM)architecture was constructed.The lower-limb sEMG and IMU data of 5 children with cerebral palsy during walking were collected and preprocessed by denoising and normalization.Spatial features were extracted via CNN,and temporal dependencies were captured by LSTM to construct a prediction model of knee joint angles.The model performance was evaluated using the mean absolute error(MAE)and coefficient of determination(R2).Results The evaluation results demonstrated that the model achieved high accuracy in predicting the gait trajectories of children with cerebral palsy,with MAE=0.083 7±0.012 8 and R2=0.986 1±0.007 1.The predictive performance of the model was effectively enhanced by the multimodal data fusion combined with CNN-LSTM architecture which accurately captured the complex motion patterns of children with cerebral palsy.Conclusion The motion prediction model based on multimodal data fusion and the CNN-LSTM architecture constructed in this study provides a new technical method for the quantitative assessment of motor dysfunction in children with cerebral palsy,and has potential application value,especially in the design of personalized rehabilitation programs and assistive devices.
刘爻;崔朝旭;周璇;范起萌;蔡丽莉;付彬彬;李庭睿;王多琎
上海理工大学康复工程与技术研究所(中国 上海 200093)上海理工大学康复工程与技术研究所(中国 上海 200093)上海交通大学医学院附属新华医院康复医学科(中国 上海 200092)上海交通大学医学院附属新华医院康复医学科(中国 上海 200092)上海交通大学医学院附属新华医院康复医学科(中国 上海 200092)上海交通大学医学院附属新华医院康复医学科(中国 上海 200092)上海交通大学医学院附属新华医院康复医学科(中国 上海 200092)上海理工大学康复工程与技术研究所(中国 上海 200093)
表面肌电信号多模态数据融合脑性瘫痪神经网络
surface electromyographymultimodal data fusioncerebral palsyneural network
《教育生物学杂志》 2026 (2)
91-98,8
国家重点研发计划(2023YFC3604803)
评论