Exploring the Possibility of Photoplethysmography-Based Human Activity Recognition Using Convolutional Neural Networks

• Published in: Sensors (Basel, Switzerland) Vol. 24; no. 5; p. 1610
• Main Authors: Ryu, Semin, Yun, Suyeon, Lee, Sunghan, Jeong, In Cheol
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01-03-2024; MDPI
• Subjects: Accuracy; Biomechanics; Biometrics; convolutional neural networks; cross-subject validation; Datasets; Deep learning; Electrocardiogram; Electrocardiography; Electrocardiography - methods; Exercise; Fitness equipment; Heart rate; Human Activities; human activity recognition; Humans; Methods; Neural networks; Neural Networks, Computer; photoplethysmography; Photoplethysmography - methods; Physiology; Privacy; Prospective Studies; Running; Sensors; Smartwatches; Walking; Wearable computers; window size; United States > US; window size; convolutional neural networks; photoplethysmography; human activity recognition; cross-subject validation
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s24051610

Various sensing modalities, including external and internal sensors, have been employed in research on human activity recognition (HAR). Among these, internal sensors, particularly wearable technologies, hold significant promise due to their lightweight nature and simplicity. Recently, HAR techniques leveraging wearable biometric signals, such as electrocardiography (ECG) and photoplethysmography (PPG), have been proposed using publicly available datasets. However, to facilitate broader practical applications, a more extensive analysis based on larger databases with cross-subject validation is required. In pursuit of this objective, we initially gathered PPG signals from 40 participants engaged in five common daily activities. Subsequently, we evaluated the feasibility of classifying these activities using deep learning architecture. The model's performance was assessed in terms of accuracy, precision, recall, and F-1 measure via cross-subject cross-validation (CV). The proposed method successfully distinguished the five activities considered, with an average test accuracy of 95.14%. Furthermore, we recommend an optimal window size based on a comprehensive evaluation of performance relative to the input signal length. These findings confirm the potential for practical HAR applications based on PPG and indicate its prospective extension to various domains, such as healthcare or fitness applications, by concurrently analyzing behavioral and health data through a single biometric signal.