Recognizing Disguised Faces

Fig 1. Illustration of interclass and intraclass variations arising due to utilization of disguise accessories.

Recognizing Disguised Faces

Face verification, though an easy task for humans, is a long-standing open research area. This is largely due to the challenging covariates, such as disguise and aging, which make it very hard to accurately verify the identity of a person. This paper investigates human and machine performance for recognizing/verifying disguised faces. Performance is also evaluated under familiarity and match/mismatch with the ethnicity of observers. The findings of this study are used to develop an automated algorithm to verify the faces presented under disguise variations. We use automatically localized feature descriptors which can identify disguised face patches and account for this information to achieve improved matching accuracy.

We also explore the feasibility of face verification under disguise variations using multi-spectrum (visible and thermal) face images. Our framework classifies the local facial regions of both visible and thermal face images into biometric (regions without disguise) and non-biometric (regions with disguise) classes. The biometric patches are then used for facial feature extraction and matching. The experimental results suggest that the proposed framework improves the performance compared to existing algorithms. We also provide human performace evaulation for matching disguised face. However there is a need for more research to address this important covariate.

We prepared a dataset containing images pertaining to 75 subjects with different kinds of disguise variations. The version 1 of the dataset consists of images captured in visible spectrum. It is named as IIIT-Delhi Disguise Version 1 face database (ID V1). The IIITD In and Beyond Visible Spectrum Disguise database (I2BVSD)consists of face images captured in visible as well as thermal spectrum. Thus, ID V1 is a subset of I2BVSD.

Dataset

Fig 2. Sample images from the I2BVSD database (left) corresponding images captured in visible spectrum, and (right) contains images acquired in thermal spectrum.

• IIIT-Delhi Disguise Version 1 face database (ID V1):[681 visible spectrum images]
  • Raw version (2.9GB) (CRC32: 17596FBD, MD5: AE9C4A5B4121234B1B96789F36A7DF60, SHA-1: 1FE976E2CD2FCE0C013BB2197E3B13C3D77E5610)
  • Cropped version (11MB) (CRC32: 5F703418, MD5: 91C3D309A1003DFCBD927BAD1AD52127, SHA-1: 831260B1058E179D849C4C0C22F51F1637F52CA)
• IIITD In and Beyond Visible Spectrum Disguise database (I2BVSD): [681 images in visible and thermal spectrum each]
  • Raw version part 1 (2.9GB) (CRC32: 17596FBD, MD5: AE9C4A5B4121234B1B96789F36A7DF60, SHA-1: 1FE976E2CD2FCE0C013BB2197E3B13C3D77E5610)
  • Raw version part 2 (79.2MB) (CRC32: 2B6546CD, MD5: D938ECCF765FFAD81A576BCB1C7A7EC3, SHA-1: 6609AB4AC01D339058005514AB78636B94C923BB)
  • Cropped version part 1 (11MB) (CRC32: 5F703418, MD5: 91C3D309A1003DFCBD927BAD1AD52127, SHA-1: 831260B1058E179D849C4C0C22F51F1637F52CA)
  • Cropped version part 2 (11MB) (CRC32: 0D72B44E, MD5: AE621B624D9EC7E6EF7A6042C5A249B9, SHA-1: FDDC2DDB56061C72C1D30E555AA82CA2466170CE)

• To obtain the password for the compressed file, email the duly filled license agreement to databases@iab-rubric.org with the subject line "License agreement for IIIT-D Disguise Face Database".
  As soon as we obtain the signed license agreement in scanned form, we would provide you with the access to our database.
  NOTE: The license agreement has to be signed by someone having the legal authority to sign on behalf of the institute, such as the head of the institution or registrar. If a license agreement is signed by someone else, it will not be processed further.

This database is available only for research and educational purpose and not for any commercial use. If you use the database in any publications or reports, you must refer to the following papers:

Publication

• T. I. Dhamecha, R. Singh, M. Vatsa, and A. Kumar, Recognizing Disguised Faces: Human and Machine Evaluation, PLoS ONE, 9(7): e99212, 2014.
• T. I. Dhamecha, A. Nigam, R. Singh, and M. Vatsa Disguise Detection and Face Recognition in Visible and Thermal Spectrums, In proceedings of International Conference on Biometrics, 2013 (Poster)

Back