Efficient Region of Interest Based Metric Learning for Effective Open World Deep Face Recognition Applications

• Published in: IEEE access Vol. 10; pp. 76168 - 76184
• Main Authors: Faizabadi, Ahmed Rimaz, Zaki, Hasan Firdaus Bin Mohd, Abidin, Zulkifli Bin Zainal, Hashim, Nik Nur Wahidah Nik, Husman, Muhammad Afif Bin
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Adaptation; Adaptation models; Adaptive threshold; Algorithms; Artificial neural networks; biometric system; Datasets; Deep learning; deep metric learning; distance metric; Downtime; Face recognition; Feature extraction; Ill posed problems; imbalance binary classification; Learning systems; Machine learning; Measurement; Performance enhancement; Performance evaluation
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2022.3192520

Face Recognition (FR) has recently gained traction as a widely used biometric for security-based applications such as facial recognition payment. The widespread use is due to improvements in deep convolutional neural networks (CNN) and large datasets. However, FR is still an ill-posed problem, especially in an open world scenario. Existing FR methods require finetuning, classifier retraining, or global metric learning to improve the performance for effective domain adaptation. It incurs an undesirable downtime. Open world FR must identify the persons for whom the FR model is not trained. It also produces imbalanced pairs, giving a false sense of high performance. The popular fixed threshold strategies, such as <inline-formula> <tex-math notation="LaTeX">\sigma </tex-math></inline-formula> values, also lead to sub-optimal performance. This paper proposes a fast and efficient threshold adapter algorithm using an effective Region of Interest (ROI) setting for metric learning. It uses five different ROI schemes to find an adaptive threshold in real-time. The algorithm also determines the FR model quality and usability after new enrolments. To establish the effectiveness, we investigated various threshold finding strategies for five state-of-the-art face recognition algorithms for open world adaptation on different datasets. We also proposed a novel performance evaluation metric for FR algorithms on imbalanced datasets. Experimental results demonstrated that the proposed metric learning is up to 12 times faster than the nearest competitor while reporting higher accuracy and fewer errors. The study suggests that the F1-score is vital as a performance indicator for imbalanced pair evaluation, and accuracy at the highest reported F1-score is the desired metric for benchmarking FR algorithms in open world.