Deep learning smartphone application for real‐time detection of defects in buildings

• Published in: Structural control and health monitoring Vol. 28; no. 7
• Main Authors: Perez, Husein, Tah, Joseph H. M.
• Format: Journal Article
• Language: English
• Published: Pavia Wiley Subscription Services, Inc 01-07-2021
• Subjects: Buildings; Cameras; Computer vision; condition assessment and health monitoring; Condition monitoring; Deep learning; Defects; defects in buildings; Feature extraction; Flaw detection; Inspection; object detection; Physical work; smartphone applications; Smartphones
• ISSN: 1545-2255; 1545-2263
• DOI: 10.1002/stc.2751

Summary
Condition assessment and health monitoring (CAHM) of built assets requires effective and continuous monitoring of any changes to the material and/or geometric properties of the assets in order to detect any early signs of defects or damage and act on time. Most of the traditional CAHM techniques, however, depend on manual labour despite that, in some cases, the inspection environment can be unsafe and could lead to low efficiency or misjudgement of the severity of the defect. In recent years, computer vision techniques have been proposed as an automated alternative to the traditional CAHM techniques as methods for extracting and analysing feature‐related information from asset images and videos. Such methods have proven to be robust and effective solutions, complementary to current time‐consuming and unreliable manual observational practices. This work is concerned with the development of a deep learning‐based smartphone app, which allows real‐time detection of four types of defects in buildings, namely, cracks, mould, stain and paint deterioration. Since smartphones are widely available and equipped with high‐resolution cameras, this application can offer a practical, low‐cost solution for condition assessment procedures of built assets. The obtained results are promising and support the feasibility and effectiveness of the approach to identify and classify various types of building defects.