More Like this

1. Emotion depends on context, culture, and their interaction: Evidence from effective connectivity.

   https://doi.org/https://doi.org/10.1093/scan/nsab092  

   Pugh, Z.H. ; Choo, S ; Leshin, J. ; Lindquist, K.A ; Nam, C.S. ( July 2021 , Social cognitive and affective neuroscience)

   Situated models of emotion hypothesize that emotions are optimized for the context at hand, but most neuroimaging approaches ignore context. For the first time, we applied Granger causality (GC) analysis to determine how an emotion is affected by a person’s cultural background and situation. Electroencephalographic recordings were obtained from mainland Chinese (CHN) and US participants as they viewed and rated fearful and neutral images displaying either social or non-social contexts. Independent component analysis and GC analysis were applied to determine the epoch of peak effect for each condition and to identify sources and sinks among brain regions of interest. We found that source–sink couplings differed across culture, situation and culture × situation. Mainland CHN participants alone showed preference for an early-onset source–sink pairing with the supramarginal gyrus as a causal source, suggesting that, relative to US participants, CHN participants more strongly prioritized a scene’s social aspects in their response to fearful scenes. Our findings suggest that the neural representation of fear indeed varies according to both culture and situation and their interaction in ways that are consistent with norms instilled by cultural background.
2. Intersecting Identities of Women in Engineering

   Cross, K. ( June 2018 , ASEE annual conference & exposition proceedings)

   Giving a voice to marginalized groups and understanding the double bind is critical, especially after the Charlotte, VA protests and the white supremacist discourse that has pervaded our country. The result of the discourse, more subtle beliefs about white superiority and institutional barriers is an overrepresentation of women of color (WOC) in the leaky STEM pipeline and thus the loss of their presence and expertise. The absence of WOC hinders knowledge production and innovation that is essential for societal advancements and scientific discovery. The “chilly climate” is often cited as an explanation for the loss of WOC from STEM. However, interactions that allow the “chilly climate” to persist have yet to be characterized. This lack of understanding can inhibit the professional engineering identity construction of WOC. Additionally, engineering education research typically focuses on a single identity dimension such as gender or socio-economic status. These studies connect an identity dimension to student outcomes and few studies clarify how the identity is situated within the social context of the engineering culture. Consequently, a need exist to examine how the engineering culture impacts multiple components of identity and intersecting identities of WOC. To address this gap, our study illuminates the intersections of identitymore »of WOC and how they perceive the double bind of race and gender within the context of their engineering education. The data reported here are a part of a larger, sequential mixed-methods study (N=276) of undergraduate female engineering students at a large Midwestern research university. This project applies the framework of intersectionality with the following scales: Engineering Identity, Ethnic Identity, Womanist Identity, Microaggressions, and Depression. We use intersectionality to investigate the interaction between intersecting social identities and educational conditions. We introduce the Womanist Identity Attitude scale to engineering education research, which provides an efficient way to understand gender, racial, and intersecting identity development of WOC. We utilize the microaggressions scale, in order to develop quantitative measures of gender-racial discrimination in STEM and compare to previous research. We also included the Patient Health Questionnaire (PHQ-9), an instrument for measuring depression, to assess health outcomes of respondents’ experiences of gender-racial microaggressions. Our three emergent findings suggest instrument accuracy and provide insight into the identity and depression subscales. Factor analysis established a basis to refine our quantitative survey instruments, and indicated that 23 items could offer greater accuracy than the original 54 items instrument. Second, the majority of participants report a high level of identification with engineering. This result rebuffs the long-held stereotypes that females are less interested in engineering. Third, a significant portion of female respondents self-reported PHQ-9 scores in the 15-19 range, which corresponds with a “major depression, moderately severe” provisional diagnosis, the second-highest in severity in the PHQ-9 provisional diagnosis scale. These elevated levels of depression correlated significantly to frequent instances of microaggressions. These preliminary findings are providing never-before seen insight into the experiences of WOC in engineering. Our results suggest a path to accurately describe the experiences of WOC in engineering, while revealing options for improving inclusion efforts.« less
3. Intersecting Identities of Women in Engineering

   Mendenhall, Ruby ; Cross, Kelly J. ; Amos, Jennifer R. ; Clancy, Kathryn B.H. ; Imoukhuede, Princess ; Cromley, Jennifer Grace. ( June 2018 , ASEE annual conference & exposition proceedings)

   Giving a voice to marginalized groups and understanding the double bind is critical, especially after the Charlotte, VA protests and the white supremacist discourse that has pervaded our country. The result of the discourse, more subtle beliefs about white superiority and institutional barriers is an overrepresentation of women of color (WOC) in the leaky STEM pipeline and thus the loss of their presence and expertise. The absence of WOC hinders knowledge production and innovation that is essential for societal advancements and scientific discovery. The “chilly climate” is often cited as an explanation for the loss of WOC from STEM. However, interactions that allow the “chilly climate” to persist have yet to be characterized. This lack of understanding can inhibit the professional engineering identity construction of WOC. Additionally, engineering education research typically focuses on a single identity dimension such as gender or socio-economic status. These studies connect an identity dimension to student outcomes and few studies clarify how the identity is situated within the social context of the engineering culture. Consequently, a need exist to examine how the engineering culture impacts multiple components of identity and intersecting identities of WOC. To address this gap, our study illuminates the intersections of identitymore »of WOC and how they perceive the double bind of race and gender within the context of their engineering education. The data reported here are a part of a larger, sequential mixed-methods study (N=276) of undergraduate female engineering students at a large Midwestern research university. This project applies the framework of intersectionality with the following scales: Engineering Identity, Ethnic Identity, Womanist Identity, Microaggressions, and Depression. We use intersectionality to investigate the interaction between intersecting social identities and educational conditions. We introduce the Womanist Identity Attitude scale to engineering education research, which provides an efficient way to understand gender, racial, and intersecting identity development of WOC. We utilize the microaggressions scale, in order to develop quantitative measures of gender-racial discrimination in STEM and compare to previous research. We also included the Patient Health Questionnaire (PHQ-9), an instrument for measuring depression, to assess health outcomes of respondents’ experiences of gender-racial microaggressions. Our three emergent findings suggest instrument accuracy and provide insight into the identity and depression subscales. Factor analysis established a basis to refine our quantitative survey instruments, and indicated that 23 items could offer greater accuracy than the original 54 items instrument. Second, the majority of participants report a high level of identification with engineering. This result rebuffs the long-held stereotypes that females are less interested in engineering. Third, a significant portion of female respondents self-reported PHQ-9 scores in the 15-19 range, which corresponds with a “major depression, moderately severe” provisional diagnosis, the second-highest in severity in the PHQ-9 provisional diagnosis scale. These elevated levels of depression correlated significantly to frequent instances of microaggressions. These preliminary findings are providing never-before seen insight into the experiences of WOC in engineering. Our results suggest a path to accurately describe the experiences of WOC in engineering, while revealing options for improving inclusion efforts.« less
4. Micro-expressions in Animated Agents

   https://doi.org/10.54941/ahfe1001081  

   Hou, Tianyu ; Adamo, Nicoletta ; Villani, Nicholas ( January 2022 , AHFE International)

   The overall goal of our research is to develop a system of intelligent multimodal affective pedagogical agents that are effective for different types of learners (Adamo et al., 2021). While most of the research on pedagogical agents tends to focus on the cognitive aspects of online learning and instruction, this project explores the less-studied role of affective (or emotional) factors. We aim to design believable animated agents that can convey realistic, natural emotions through speech, facial expressions, and body gestures and that can react to the students’ detected emotional states with emotional intelligence. Within the context of this goal, the specific objective of the work reported in the paper was to examine the extent to which the agents’ facial micro-expressions affect students’ perception of the agents’ emotions and their naturalness. Micro-expressions are very brief facial expressions that occur when a person either deliberately or unconsciously conceals an emotion being felt (Ekman &Friesen, 1969). Our assumption is that if the animated agents display facial micro expressions in addition to macro expressions, they will convey higher expressive richness and naturalness to the viewer, as “the agents can possess two emotional streams, one based on interaction with the viewer and the other basedmore »on their own internal state, or situation” (Queiroz et al. 2014, p.2).The work reported in the paper involved two studies with human subjects. The objectives of the first study were to examine whether people can recognize micro-expressions (in isolation) in animated agents, and whether there are differences in recognition based on the agent’s visual style (e.g., stylized versus realistic). The objectives of the second study were to investigate whether people can recognize the animated agents’ micro-expressions when integrated with macro-expressions, the extent to which the presence of micro + macro-expressions affect the perceived expressivity and naturalness of the animated agents, the extent to which exaggerating the micro expressions, e.g. increasing the amplitude of the animated facial displacements affects emotion recognition and perceived agent naturalness and emotional expressivity, and whether there are differences based on the agent’s design characteristics. In the first study, 15 participants watched eight micro-expression animations representing four different emotions (happy, sad, fear, surprised). Four animations featured a stylized agent and four a realistic agent. For each animation, subjects were asked to identify the agent’s emotion conveyed by the micro-expression. In the second study, 234 participants watched three sets of eight animation clips (24 clips in total, 12 clips per agent). Four animations for each agent featured the character performing macro-expressions only, four animations for each agent featured the character performing macro- + micro-expressions without exaggeration, and four animations for each agent featured the agent performing macro + micro-expressions with exaggeration. Participants were asked to recognize the true emotion of the agent and rate the emotional expressivity ad naturalness of the agent in each clip using a 5-point Likert scale. We have collected all the data and completed the statistical analysis. Findings and discussion, implications for research and practice, and suggestions for future work will be reported in the full paper. ReferencesAdamo N., Benes, B., Mayer, R., Lei, X., Meyer, Z., &Lawson, A. (2021). Multimodal Affective Pedagogical Agents for Different Types of Learners. In: Russo D., Ahram T., Karwowski W., Di Bucchianico G., Taiar R. (eds) Intelligent Human Systems Integration 2021. IHSI 2021. Advances in Intelligent Systems and Computing, 1322. Springer, Cham. https://doi.org/10.1007/978-3-030-68017-6_33Ekman, P., &Friesen, W. V. (1969, February). Nonverbal leakage and clues to deception. Psychiatry, 32(1), 88–106. https://doi.org/10.1080/00332747.1969.11023575 Queiroz, R. B., Musse, S. R., &Badler, N. I. (2014). Investigating Macroexpressions and Microexpressions in Computer Graphics Animated Faces. Presence, 23(2), 191-208. http://dx.doi.org/10.1162/

   « less
5. The Role of Unimodal Feedback Pathways in Gender Perception During Activation of Voice and Face Areas

   https://doi.org/10.3389/fnsys.2021.669256  

   Abbatecola, Clement ; Gerardin, Peggy ; Beneyton, Kim ; Kennedy, Henry ; Knoblauch, Kenneth ( May 2021 , Frontiers in Systems Neuroscience)

   Cross-modal effects provide a model framework for investigating hierarchical inter-areal processing, particularly, under conditions where unimodal cortical areas receive contextual feedback from other modalities. Here, using complementary behavioral and brain imaging techniques, we investigated the functional networks participating in face and voice processing during gender perception, a high-level feature of voice and face perception. Within the framework of a signal detection decision model, Maximum likelihood conjoint measurement (MLCM) was used to estimate the contributions of the face and voice to gender comparisons between pairs of audio-visual stimuli in which the face and voice were independently modulated. Top–down contributions were varied by instructing participants to make judgments based on the gender of either the face, the voice or both modalities ( N = 12 for each task). Estimated face and voice contributions to the judgments of the stimulus pairs were not independent; both contributed to all tasks, but their respective weights varied over a 40-fold range due to top–down influences. Models that best described the modal contributions required the inclusion of two different top–down interactions: (i) an interaction that depended on gender congruence across modalities (i.e., difference between face and voice modalities for each stimulus); (ii) an interaction that depended onmore »the within modalities’ gender magnitude. The significance of these interactions was task dependent. Specifically, gender congruence interaction was significant for the face and voice tasks while the gender magnitude interaction was significant for the face and stimulus tasks. Subsequently, we used the same stimuli and related tasks in a functional magnetic resonance imaging (fMRI) paradigm ( N = 12) to explore the neural correlates of these perceptual processes, analyzed with Dynamic Causal Modeling (DCM) and Bayesian Model Selection. Results revealed changes in effective connectivity between the unimodal Fusiform Face Area (FFA) and Temporal Voice Area (TVA) in a fashion that paralleled the face and voice behavioral interactions observed in the psychophysical data. These findings explore the role in perception of multiple unimodal parallel feedback pathways.« less