A machine learning-based approach for constructing remote photoplethysmogram signals from video cameras

Abstract

Background

Advancements in health monitoring technologies are increasingly relying on capturing heart signals from video, a method known as remote photoplethysmography (rPPG). This study aims to enhance the accuracy of rPPG signals using a novel computer technique.

Methods

We developed a machine-learning model to improve the clarity and accuracy of rPPG signals by comparing them with traditional photoplethysmogram (PPG) signals from sensors. The model was evaluated across various datasets and under different conditions, such as rest and movement. Evaluation metrics, including dynamic time warping (to assess timing alignment between rPPG and PPG) and correlation coefficients (to measure the linear association between rPPG and PPG), provided a robust framework for validating the effectiveness of our model in capturing and replicating physiological signals from videos accurately.

Results

Our method showed significant improvements in the accuracy of heart signals captured from video, as evidenced by dynamic time warping and correlation coefficients. The model performed exceptionally well, demonstrating its effectiveness in achieving accuracy comparable to direct-contact heart signal measurements.

Conclusions

This study introduces a novel and effective machine-learning approach for improving the detection of heart signals from video. The results demonstrate the flexibility of our method across various scenarios and its potential to enhance the accuracy of health monitoring applications, making it a promising tool for remote healthcare.

Plain language summary

This research explores a new way to monitor health using video, which is less invasive than traditional methods that require direct skin contact. We developed a computer program that improves the accuracy of heart signals captured from video. This is done by comparing these video-based signals with standard clinical signals from physical sensors on the skin. Our findings show that this new method can match the accuracy of conventional clinical methods, enhancing the reliability of non-contact health monitoring. This advancement could make health monitoring more accessible and comfortable, offering a potential for doctors to track patient health remotely, making everyday medical assessments easier and less intrusive.

Abstract

Ontiveros, Elgendi et al. devise and validate a machine learning approach that improves the quality of photoplethysmogram signals that can be obtained from video data. This ultimately contributes to advances in non-invasive health monitoring technologies.