skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: A CNN-based personalized system for attention detection in wayfinding tasks
Firefighters are often exposed to extensive wayfinding information in various formats owing to the increasing complexity of the built environment. Because of the individual differences in processing assorted types of information, a personalized cognition-driven intelligent system is necessary to reduce the cognitive load and improve the performance in the wayfinding tasks. However, the mixed and multi-dimensional information during the wayfinding tasks bring severe challenges to intelligent systems in detecting and nowcasting the attention of users. In this research, a virtual wayfinding experiment is designed to simulate the human response when subjects are memorizing or recalling different wayfinding information. Convolutional neural networks (CNNs) are designed for automated attention detection based on the power spectrum density of electroencephalography (EEG) data collected during the experiment. The performance of the personalized model and the generalized model are compared and the result shows a personalized CNN is a powerful classifier in detecting the attention of users with high accuracy and efficiency. The study thus will serve a foundation to support the future development of personalized cognition-driven intelligent systems.  more » « less
Award ID(s):
1761950
PAR ID:
10299025
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Advanced engineering informatics
Volume:
46
ISSN:
1873-5320
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Journal of computing in civil engineering)
    null (Ed.)
    Amid the rapid development of building information technologies, wayfinding information has become more accessible to building users and first responders. As a result, a realistic risk of cognitive load related to the wayfinding information processing starts to emerge. As cognition-driven adaptive wayfinding information systems become increasingly captivated to overcome challenges of cognition overload due to overwhelming information, a practical and non-invasive method to monitor and classify cognitive loads during the processing of wayfinding information is needed. This paper tests a Functional Near-Infrared Spectroscopy (fNIRS) based method to identify cognitive load related to wayfinding information processing. It provides a holistic fNIRS signal analytical pipeline to extract hemodynamic response features in the prefrontal cortex (PFC) for cognitive load classification. A human-subject experiment (N=15) based on the Sternberg working memory test was performed to model the relationship between fNIRS features and cognitive load. Personalized models were also evaluated to capture individual differences and identify unique contributing features to each person. The results find that fNIRS-based model can help classify cognitive load changes driven by the different levels of task difficulty with satisfactory performance (avg. accuracy rate 70.02±4.41 percent). The findings also demonstrate that personalized models, instead of universal models, are needed for classifying cognitive load based on neuroimaging data. fNIRS has demonstrated comparable advantages over other neuroimaging methods in cognitive load classification given its robustness to motion artifacts and the satisfactory predictability. 
    more » « less
  2. ; ; ; ; (, Cognitive Computation)
    null (Ed.)
    Abstract Signage systems are critical for communicating spatial information during wayfinding among a plethora of noise in the environment. A proper signage system can improve wayfinding performance and user experience by reducing the perceived complexity of the environment. However, previous models of sign-based wayfinding do not incorporate realistic noise or quantify the reduction in perceived complexity from the use of signage. Drawing upon concepts from information theory, we propose and validate a new agent-signage interaction model that quantifies available wayfinding information from signs for wayfinding. We conducted two online crowd-sourcing experiments to compute the distribution of a sign’s visibility and an agent’s decision-making confidence as a function of observation angle and viewing distance. We then validated this model using a virtual reality (VR) experiment with trajectories from human participants. The crowd-sourcing experiments provided a distribution of decision-making entropy (conditioned on visibility) that can be applied to any sign/environment. From the VR experiment, a training dataset of 30 trajectories was used to refine our model, and the remaining test dataset of 10 trajectories was compared with agent behavior using dynamic time warping (DTW) distance. The results revealed a reduction of 38.76% in DTW distance between the average trajectories before and after refinement. Our refined agent-signage interaction model provides realistic predictions of human wayfinding behavior using signs. These findings represent a first step towards modeling human wayfinding behavior in complex real environments in a manner that can incorporate several additional random variables (e.g., environment layout). 
    more » « less
  3. ; ; ; (, Artificial Intelligence in Education 2020)
    Cognitive control and rule learning are two important mechanisms that explain how goals influence behavior and how knowledge is acquired. These mechanisms are studied heavily in cognitive science literature within highly controlled tasks to understand human cognition. Although they are closely linked to the student behaviors that are often studied within intelligent tutoring systems (ITS), their direct effects on learning have not been explored. Understanding these underlying cognitive mechanisms of beneficial and harmful student behaviors can provide deeper insight into detecting such behaviors and improve predictive models of student learning. In this paper, we present a thinkaloud study where we asked students to narrate their thought processes while solving probability problems in ASSISTments. Students are randomly assigned to one of two conditions that are designed to induce the two modes of cognitive control based on the Dual Mechanisms of Control framework. We also observe how the students go through the phases of rule learning as defined in a rule learning paradigm. We discuss the effects of these different mechanisms on learning, and how the information they provide can be used in student modeling. 
    more » « less
  4. ; ; ; (, International Conference of Artificial Intelligence in Education)
    Cognitive control and rule learning are two important mechanisms that explain how goals influence behavior and how knowledge is acquired. These mechanisms are studied heavily in cognitive science literature within highly controlled tasks to understand human cognition. Although they are closely linked to the student behaviors that are often studied within intelligent tutoring systems (ITS), their direct effects on learning have not been explored. Understanding these underlying cognitive mechanisms of beneficial and harmful student behaviors can provide deeper insight into detecting such behaviors and improve predictive models of student learning. In this paper, we present a thinkaloud study where we asked students to narrate their thought processes while solving probability problems in ASSISTments. Students are randomly assigned to one of two conditions that are designed to induce the two modes of cognitive control based on the Dual Mechanisms of Control framework. We also observe how the students go through the phases of rule learning as defined in a rule learning paradigm. We discuss the effects of these different mechanisms on learning, and how the information they provide can be used in student modeling. 
    more » « less
  5. (, Construction Research Congress 2020)
    Driven by the increasing complexity of built environments, firefighters are often exposed to extensive wayfinding information which could cause high cognitive load and ineffective or even dangerous decision making. To reduce injuries and fatal incidents in firefighters’ line of duty, this study aims at measuring the cognitive load and identifying the source of such cognitive overload in wayfinding information review. We developed a Sternberg Test to induce cognitive load on participants pertaining to working memory development, where participants were required to memorize colors, letters, numbers, directions, icons, words, and letter combinations that are relevant to wayfinding tasks. We used an Electroencephalogram (EEG) device to monitor neural activities especially in frontal, parietal, and occipital areas of brain. The fast Fourier transformation (FFT) was applied to separate the sub-band energy. The speed of response in Sternberg Test and the EEG signals were compared to show the coherence between the results of the two methods in representing the cognitive load in the review test. Results indicate that the cognitive load arises from diverse information can be measured to help customize wayfinding information for controlled cognitive load of firefighters in wayfinding tasks. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email