Wearable acceleration-based action recognition for long-term and continuous activity analysis in construction site

• Published in: Journal of Building Engineering Vol. 52; p. 104448
• Main Authors: Gong, Yue, Yang, Kanghyeok, Seo, JoonOh, Lee, Jin Gang
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 15-07-2022
• Subjects: Accelerometer; Action recognition; Activity taxonomy; Automation; Productivity; Wearable sensor; Action recognition; Productivity; Accelerometer; Automation; Wearable sensor; Activity taxonomy
• ISSN: 2352-7102; 2352-7102
• DOI: 10.1016/j.jobe.2022.104448

As construction is labor intensive, improvement in labor productivity is essential for achieving better project performance. Activity analysis, a widely adopted approach to improve labor productivity, measures the time spent on specific activities and can identify the root causes of low productivity. The use of automated action recognition using machine learning-based classification based on data (e.g., accelerations) collected from wearable sensors, which addresses the limitations of observation-based activity analysis, has been introduced as an effective means for monitoring and measuring activities. Despite the potential of acceleration-based action recognition, some challenges still need to be addressed from a practical perspective. For example, action categories defined in previous studies tend to be based on either body movements (e.g., walking, lifting, sitting, and standing) or work contexts (e.g., spreading mortar and laying a concrete block), thereby hindering the comprehensive understanding of the diverse nature of activities in construction. The approach needs to be further tested by noisy and continuous acceleration data collected from construction sites to validate its applicability and practicality in actual use. This research proposes a comprehensive hierarchical activity taxonomy (from Level 1 to Level 3) for acceleration-based action recognition by explicitly categorizing diverse construction activities in accordance with body movements and work contexts to address these issues. The proposed taxonomy was tested by using acceleration data collected from 18 construction workers, including formwork and rebar workers, at two construction sites in Hong Kong. Different machine-learning algorithms were implemented on the basis of hierarchically defined construction activities. Testing results indicate a competitive classification performance on Level 1 activities with 98% accuracy on the identification of work and idling. The prediction accuracy of Level 2 classification is also acceptable, with 90.6% and 86.6% classification accuracy for formwork and rebar work, respectively. Level 3 classification, which reaches an accuracy of 77.1% (formwork) and 74.9% (rebar work), requires further improvement before it can be applied in the construction field. The results of this study shall provide practical insights into the application of acceleration-based automated activity analysis for productivity monitoring.
•Long-term and large-scale data collection from the construction sites.•Hierarchical taxonomy of construction activity considering both movement and context.•Validate acceleration-based action recognition with new taxonomy and continuous data.•High accuracy on estimating worker's spent-time ratio; help expose productivity issue.