FaceCAPTCHA: a CAPTCHA that identifies the gender of face images unrecognized by existing gender classifiers

• Published in: Multimedia tools and applications Vol. 72; no. 2; pp. 1215 - 1237
• Main Authors: Kim, Jonghak, Kim, Sangtae, Yang, Joonhyuk, Ryu, Jung-hee, Wohn, KwangYun
• Format: Journal Article
• Language: English
• Published: Boston Springer US 01-09-2014; Springer; Springer Nature B.V
• Subjects: Accounting; Accuracy; Algorithms; Applied sciences; Artificial intelligence; Automation; Biometrics; Classification; Computer Communication Networks; Computer Science; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Computers; Data Structures and Information Theory; Exact sciences and technology; Face; Face recognition; Filtering; Gender; Human; Image processing systems; Manuals; Memory and file management (including protection and security); Memory organisation. Data processing; Multimedia Information Systems; Pattern recognition. Digital image processing. Computational geometry; Software; Special Purpose and Application-Based Systems; Studies; Tasks; United States > US; Crowdsourcing; CAPTCHA; Human computation; Gender classification; Web application; Image tagging; Occlusion; Image processing; Sex; Information source; User interface; Classification; Facies; World wide web; Computer security; Computer attack; Filtering; Probabilistic approach; Community participation; Viewing angle; Social network; Image analysis; Authentication; Genderclassification; Tagging; Internet; Occultation
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-013-1422-z

Computers tend to fail to classify human faces by gender, especially upon changes in viewpoint or upon occlusion that make it more difficult to extract the necessary image features. In contrast, humans are good at identifying gender but have difficulties in dealing with a large number of images. Accounting for this gap, we proposed FaceCAPTCHA, a novel image-based CAPTCHA that asks users to identify the gender of face images whose gender cannot be recognized by computers (gender-indiscernible faces). By converting the manual gender classification task into a CAPTCHA test, FaceCAPTCHA was designed to not only continuously identify the gender of gender-indiscernible faces but also differentiate between humans and computers and generate new test images. Our user studies showed that FaceCAPTCHA reliably identifies gender-indiscernible faces. A single eight-image FaceCAPTCHA test was completed in 12.41 s on average with a human success rate of 86.51 %, which can be further increased by filtering error-prone test images. In contrast, the probability of passing a FaceCAPTCHA test by random guessing was 0.006 %. We could therefore conclude that FaceCAPTCHA is robust against malicious attacks and easy enough for practical use.