skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Monocular Facial Presentation–Attack–Detection: Classifying Near-Infrared Reflectance Patterns
This paper presents a novel material spectroscopy approach to facial presentation–attack–defense (PAD). Best-in-class PAD methods typically detect artifacts in the 3D space. This paper proposes similar features can be achieved in a monocular, single-frame approach by using controlled light. A mathematical model is produced to show how live faces and their spoof counterparts have unique reflectance patterns due to geometry and albedo. A rigorous dataset is collected to evaluate this proposal: 30 diverse adults and their spoofs (paper-mask, display-replay, spandex-mask and COVID mask) under varied pose, position, and lighting for 80,000 unique frames. A panel of 13 texture classifiers are then benchmarked to verify the hypothesis. The experimental results are excellent. The material spectroscopy process enables a conventional MobileNetV3 network to achieve 0.8% average-classification-error rate, outperforming the selected state-of-the-art algorithms. This demonstrates the proposed imaging methodology generates extremely robust features.  more » « less
Award ID(s):
1816019
PAR ID:
10417495
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Applied Sciences
Volume:
13
Issue:
3
ISSN:
2076-3417
Page Range / eLocation ID:
1987
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. When liquid metal batteries are charged or discharged, strong electrical currents are passing through the three liquid layers that we find in their interior. This may result in the metal pad roll instability that drives gravity waves on the interfaces between the layers. In this paper, we investigate theoretically metal pad roll instability in idealised cylindrical liquid metal batteries that were simulated previously by Weber et al. ( Phys. Fluids , vol. 29, no. 5, 2017 b , 054101) and Horstmann et al. ( J. Fluid Mech. , vol. 845, 2018, pp. 1–35). Near the instability threshold, we expect weakly destabilised gravity waves, and in this parameter regime, we can use perturbation methods to find explicit formulas for the growth rate of all possible waves. This perturbative approach also allows us to include dissipative effects, hence we can locate the instability threshold with good precision. We show that our theoretical growth rates are in quantitative agreement with previous and new direct numerical simulations. We explain how our theory can be used to estimate a lower bound on cell size beneath which metal pad roll instability is unlikely. 
    more » « less
  2. In this paper, we look at how depth data can benefit existing object masking methods applied in occluded scenes. Masking the pixel locations of objects within scenes helps computers get a spatial awareness of where objects are within images. The current state-of-the-art algorithm for masking objects in images is Mask R-CNN, which builds on the Faster R-CNN network to mask object pixels rather than just detecting their bounding boxes. This paper examines the weaknesses Mask R-CNN has in masking people when they are occluded in a frame. It then looks at how depth data gathered from an RGB-D sensor can be used. We provide a case study to show how simply applying thresholding methods on the depth information can aid in distinguishing occluded persons. The intention of our research is to examine how features from depth data can benefit object pixel masking methods in an explainable manner, especially in complex scenes with multiple objects. 
    more » « less
  3. This paper is a work-in-progress, focused on the utilization of the Rising Scholars Program to introduce minority students to experiential engineering projects within Agricultural and Biological Engineering. Traditional admissions processes at top institutions predominately utilize standardized test scores when comparing student applications. The equity of these high-stakes tests most severely affects students of low socioeconomic status (SES). The NSF-sponsored program, Rising Scholars: Web of Support used as an Indicator of Success in Engineering, was created to investigate whether alternative admission criteria could be used to identify low-SES applicants who would excel within STEM fields in higher education, even if they did not have the superior standardized testing metrics preferred by current admissions processes. The students underwent a pre-selection process to determine their eligibility. The overall experience was designed to enhance student connectivity within the collegiate environment. The Gallup-Purdue Index (2014) found that feeling supported and having learning experiences that illustrated learned principles produced a graduate who would be engaged in their work. The Rising Scholar (RS) program utilized a prescribed path through college designed to enhance these features. These positive experiences are exemplified by the Purdue Agricultural and Biological Engineering (ABE) department and how they approach the overall educational process. Faculty are motivated in their teaching, research, and extension efforts by a focus on meeting the world’s grand challenges, in which most college students are also highly interested. The Rising Scholars Program utilized the Vertically Integrated Projects model to introduce their students to real-life projects at the freshman and sophomore level, which could potentially be continued on into graduate school. Several of the RS students have worked with the Purdue ABE Hog Cooling Pad Project and these students have conducted research, prototyping, and design modifications on the pad. They have participated in five experimental bench tests of the design and four consecutive live animal studies related to the pad performance. Within these experiments, Rising Scholars students were able to work on real-life projects, with real-world impact. The preliminary hypothesis question is: Are future graduates of the Rising Scholars Program more likely to thrive in all areas of well-being due to their collegiate experiences? 
    more » « less
  4. In recent years, remarkable results have been achieved in self-supervised action recognition using skeleton sequences with contrastive learning. It has been observed that the semantic distinction of human action features is often represented by local body parts, such as legs or hands, which are advantageous for skeleton-based action recognition. This paper proposes an attention-based contrastive learning framework for skeleton representation learning, called SkeAttnCLR, which integrates local similarity and global features for skeleton-based action representations. To achieve this, a multi-head attention mask module is employed to learn the soft attention mask features from the skeletons, suppressing non-salient local features while accentuating local salient features, thereby bringing similar local features closer in the feature space. Additionally, ample contrastive pairs are generated by expanding contrastive pairs based on salient and non-salient features with global features, which guide the network to learn the semantic representations of the entire skeleton. Therefore, with the attention mask mechanism, SkeAttnCLR learns local features under different data augmentation views. The experiment results demonstrate that the inclusion of local feature similarity significantly enhances skeleton-based action representation. Our proposed SkeAttnCLR outperforms state-of-the-art methods on NTURGB+D, NTU120-RGB+D, and PKU-MMD datasets. The code and settings are available at this repository: https://github.com/GitHubOfHyl97/SkeAttnCLR. 
    more » « less
  5. Face recognition systems are susceptible to presentation attacks such as printed photo attacks, replay attacks, and 3D mask attacks. These attacks, primarily studied in visible spectrum, aim to obfuscate or impersonate a person’s identity. This paper presents a unique multispectral video face database for face presentation attack using latex and paper masks. The proposed Multispectral Latex Mask based Video Face Presentation Attack (MLFP) database contains 1350 videos in visible, near infrared, and thermal spectrums. Since the database consists of videos of subjects without any mask as well as wearing ten different masks, the effect of identity concealment is analyzed in each spectrum using face recognition algorithms. We also present the performance of existing presentation attack detection algorithms on the proposed MLFP database. It is observed that the thermal imaging spectrum is most effective in detecting face presentation attacks. 
    more » « less