A Deep Neural Network Based on Two-Stage Training for Estimating Heart Rate Variability From Camera VideosOA
Background:Studies have shown that heart rate variability(HRV)is a predictor of the prognosis of cardiovascular diseases.Contact heartbeat monitoring equipment is widely used,especially in hospitals,and benefits from the rapidity and accuracy of the detection of physiological health indicators.However,long-term contact with equipment has many adverse effects.The purpose of this study was to improve the accuracy of HRV detection via noncontact equipment,thus enabling HRV to be assessed in various scenarios.Methods:A novel deep learning approach was proposed for measuring heartbeats through camera videos.First,we performed facial segmentation and divided the face into 16 grid cells with different light balance scores.After the trend is filtered by the Hamming window,a transformer-based neural network is used to further filter the signal.Finally,heart rate(HR)and HRV are estimated.Results:We used 1 million synthetic data points for pretraining and a public dataset in combination with a dataset that we constructed for task training.The final results were obtained on a test dataset that we constructed.The accuracy for HR with a low light balance score(0.867-0.983)was greater than that with a high score(0.667-0.750).Our method had higher accuracy in estimating HR than traditional filtering methods(0.167-0.417)and state-of-the-art neural network filtering methods(0.783-0.917)did.The root mean square error of the HRV from the time domain was the lowest,and the correlation index score was the highest for the HRV from the frequency domain estimated by our method compared with those estimated by two neural networks.Conclusions:Light balance,large sample training,and two-stage training can improve the accuracy of HRV estimation.
Lan Lan;Jin Yin;Haohan Zhang;Hua Jiang;Rui Qin;Xia Zhao;Yu Zhang;Yilong Wang;Jiajun Qiu
Information Management and Data Center,Beijing Tiantan Hospital,Capital Medical University,Beijing,ChinaWest China Biomedical Big Data Center,West China Hospital,Sichuan University,Chengdu,China Med-X Center for Informatics,Sichuan University,Chengdu,ChinaWest China Hospital,Sichuan University,Chengdu,ChinaDepartment of Rehabilitation Medicine,Key Laboratory of Rehabilitation Medicine in Sichuan Province,West China Hospital,Sichuan University,Chengdu,ChinaResearch and Development Department,Zhenshu Xiangcheng(Chengdu)Technology Co.Ltd.,Chengdu,ChinaGuanghua School of Management,Peking University,Beijing,ChinaSchool of Management,Zhengzhou College of Finance and Economics,Zhengzhou,ChinaDepartment of Neurology,Beijing Tiantan Hospital,Capital Medical University,Beijing,ChinaWest China Biomedical Big Data Center,West China Hospital,Sichuan University,Chengdu,China Med-X Center for Informatics,Sichuan University,Chengdu,China
医药卫生
cameracardiovascular diseasedeep learningheart rate variabilitypretraining
《Health Care Science》 2026 (1)
P.74-84,11
National Natural Science Foundation of China,Grant/Award Number:72204169Department of Science and Technology of Sichuan Province,Grant/Award Number:2021YFS0393。
评论