An official website of the United States government
Morph images threaten Facial Recognition Systems (FRS) by presenting as multiple individuals, allowing an adversary to swap identities with another subject. Morph generation using generative adversarial networks (GANs) results in high-quality morphs unaffected by the spatial artifacts caused by landmark-based methods, but there is an apparent loss in identity with standard GAN-based morphing methods. In this paper, we propose a novel StyleGAN morph generation technique by introducing a landmark enforcement method to resolve this issue. Considering this method, we aim to enforce the landmarks of the morphed image to represent the spatial average of the landmarks of the bona fide faces and subsequently the morph images to inherit the geometric identity of both bona fide faces. Exploration of the latent space of our model is conducted using Principal Component Analysis (PCA) to accentuate the effect of both the bona fide faces on the morphed latent representation and address the identity loss issue with latent domain averaging. Additionally, to improve high frequency reconstruction in the morphs, we study the train-ability of the noise input for the StyleGAN2 model.
more »
« less
Identical Twins Face Morph Database Generation
By combining two or more face images of look-alikes, morphed face images are generated to fool Facial Recognition Systems (FRS) into falsely accepting multiple people, leading to failures in security systems. Despite several attempts in the literature, finding pairs of bona fide faces to generate the morphed images is still a challenging problem. In this paper, we morph identical twin pairs to generate extremely difficult morphs for FRS. We first explore three methods of morphed face generation, GAN-based, landmark-based, and a wavelet-based morphing approach. We leverage these methods to generate morphs from the identical twin pairs that retain high similarity to both subjects while resulting in minimal artifacts in the visual domain. To further improve the difficulty of recognizing morphed face images, we perform an ablation study to apply adversarial perturbation to the morphs such that they cannot be detected by trained morph classifiers. The evaluation of the generated identical twin-morphed dataset is performed in terms of vulnerability analysis and presentation attack error rates.
more »
« less
- Award ID(s):
- 1650474
- PAR ID:
- 10401290
- Date Published:
- Journal Name:
- Identical Twins Face Morph Database Generation
- Page Range / eLocation ID:
- 1 to 9
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
A morph is an image of an ambiguous subject generated by combining multiple individuals. The morphed image can be submitted to a facial recognition system and erroneously verified with the contributing bad actors. When submitted as a passport image, a morphed face poses a national security threat because a passport can then be shared between the individuals. As morphed images become easier to generate, it is vital that the research community expands available datasets in order to contentiously improve current technology. Children are a challenging paradigm for facial recognition systems and morphing children takes advantage of this disparity. In this paper, we morph juvenile faces in order to create a unique, high-quality dataset to challenge FRS. To the best of our knowledge, this is the first study on the generation and evaluation of juvenile morphed faces. The evaluation of the generated morphed juvenile dataset is performed in terms of vulnerability analysis and presentation attack error rates.more » « less
-
The rise of the multiracial population has been met with a growing body of research examining multiracial face perception. A common method for creating multiracial face stimuli in past research has been mathematically averaging two monoracial “parent” faces of different races to create computer-generated multiracial morphs, but conclusions from research using morphs will only be accurate to the extent that morphs yield perceptual decisions similar to those that would be made with real multiracial faces. The current studies compared race classifications of real and morphed multiracial face stimuli. We found that oval-masked morphed faces were classified as multiracial significantly more often than oval-masked real multiracial faces (Studies 1 and 2), but at comparable levels to unmasked real multiracial faces (Study 2). Study 3 examined factors that could explain differences in how morphs and real multiracial faces are categorized and pointed to the potential role that unusualness/distinctiveness might play.more » « less
-
Abstract The problem of distinguishing identical twins and non‐twin look‐alikes in automated facial recognition (FR) applications has become increasingly important with the widespread adoption of facial biometrics. Due to the high facial similarity of both identical twins and look‐alikes, these face pairs represent the hardest cases presented to facial recognition tools. This work presents an application of one of the largest twin data sets compiled to date to address two FR challenges: (1) determining a baseline measure of facial similarity between identical twins and (2) applying this similarity measure to determine the impact of doppelgangers, or look‐alikes, on FR performance for large face data sets. The facial similarity measure is determined via a deep convolutional neural network. This network is trained on a tailored verification task designed to encourage the network to group together highly similar face pairs in the embedding space and achieves a test AUC of 0.9799. The proposed network provides a quantitative similarity score for any two given faces and has been applied to large‐scale face data sets to identify similar face pairs. An additional analysis that correlates the comparison score returned by a facial recognition tool and the similarity score returned by the proposed network has also been performed.more » « less
-
Abstract In many slowly developing mammal species, males reach sexual maturity well before they develop secondary sexual characteristics. Sexually mature male orangutans have exceptionally long periods of developmental arrest. The two male morphs have been associated with behavioral alternative reproductive tactics, but this interpretation is based on cross‐sectional analyses predominantly of Northwest Sumatran populations. Here we present the first longitudinal analyses of behavioral changes of 10 adult males that have been observed in both unflanged and flanged morph. We also analyzed long‐term behavioral data on an additional 143 individually identified males from two study sites, Suaq (Sumatra,Pongo abelii) and Tuanan (Borneo,Pongo pygmaeus wurmbii), to assess male mating tactics cross‐sectionally in relation to population, male morph (unflanged and flanged), and other socio‐ecological factors. Both our longitudinal and cross‐sectional results confirm and refine previous cross‐sectional accounts of the differences in mating tactics between the unflanged and the flanged male morphs. In the unflanged morph, males exhibit higher sociability, particularly with females, and higher rates of both copulation and sexual coercion than in the flanged morph. Based on our results and those of previous studies showing that females prefer flanged males, and that flanged males have higher reproductive success, we conclude that unflanged males face a trade‐off between avoiding male‐male contest competition and gaining mating access to females, and thus follow a “best‐of‐a‐bad‐job” mating strategy.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/IJCB54206.2022.10007973
