More Like this

1. Warning users about cyber threats through sounds

   https://doi.org/10.1007/s42452-021-04703-4  

   Datta, Prerit ; Namin, Akbar Siami ; Jones, Keith S. ; Hewett, Rattikorn ( June 2021 , SN Applied Sciences)

   This paper reports a formative evaluation of auditory representations of cyber security threat indicators and cues, referred to as sonifications, to warn users about cyber threats. Most Internet browsers provide visual cues and textual warnings to help users identify when they are at risk. Although these alarming mechanisms are very effective in informing users, there are certain situations and circumstances where these alarming techniques are unsuccessful in drawing the user’s attention: (1) security warnings and features (e.g., blocking out malicious Websites) might overwhelm a typical Internet user and thus the users may overlook or ignore visual and textual warnings and, as a result, they might be targeted, (2) these visual cues are inaccessible to certain users such as those with visual impairments. This work is motivated by our previous work of the use of sonification of security warnings to users who are visually impaired. To investigate the usefulness of sonification in general security settings, this work uses real Websites instead of simulated Web applications with sighted participants. The study targets sonification for three different types of security threats: (1) phishing, (2) malware downloading, and (3) form filling. The results show that on average 58% of the participants were able to correctly remember what the sonification conveyed. Additionally, about 73% of the participants were able to correctly identify the threat that the sonification represented while performing tasks using real Websites. Furthermore, the paper introduces “CyberWarner”, a sonification sandbox that can be installed on the Google Chrome browser to enable auditory representations of certain security threats and cues that are designed based on several URL heuristics.

   It is feasible to develop sonified cyber security threat indicators that users intuitively understand with minimal experience and training.

   Users are more cautious about malicious activities in general. However, when navigating real Websites, they are less informed. This might be due to the appearance of the navigating Websites or the overwhelming issues when performing tasks.

   Participants’ qualitative responses indicate that even when they did not remember what the sonification conveyed, the sonification was able to capture the user’s attention and take safe actions in response.

    

   more » « less
2. The psychophysics of number arise from resource-limited spatial memory

   Cheyette, S.J. ( July 2021 , Cognitive Science Society)

   null (Ed.)

   People can identify the number of objects in small sets rapidly and without error but become increasingly noisy for larger sets. However, the cognitive mechanisms underlying these ubiquitous psychophysics are poorly understood. We present a model of a limitedcapacity visual system optimized to individuate and remember the location of objects in a scene which gives rise to all key aspects of number psychophysics, including error-free small number perception and scalar variability for larger numbers. We therefore propose that number psychophysics can be understood as an emergent property of primitive perceptual mechanisms — namely, the process of identifying and representing individual objects in a scene. To test our theory, we ran two experiments: a change-localization task to measure participants’ memory for the locations of objects (Experiment 1) and a numerical estimation task (Experiment 2). Our model accounts well for participants’ performance in both experiments, despite only being optimized to efficiently encode where objects are present in a scene. Our results demonstrate that the key psychophysical features of numerical cognition do not arise from separate modules or capacities specific to number, but rather from lower-level constraints on perception which are manifested even in non-numerical tasks 

   more » « less
3. Referential Form and Memory for the Discourse History

   https://doi.org/10.1111/cogs.12964  

   Yoon, Si On ; Benjamin, Aaron S. ; Brown‐Schmidt, Sarah ( April 2021 , Cognitive Science)

   The way we refer to things in the world is shaped by the immediate physical context as well as the discourse history. But what part of the discourse history is relevant to language use in the present? In four experiments, we combine the study of task‐based conversation with measures of recognition memory to examine the role of physical contextual cues that shape what speakers perceive to be a part of the relevant discourse history. Our studies leverage thedifferentiation effect, a phenomenon in which speakers are more likely to use a modified expression to refer to an object (e.g., dotted sock) if they had previously described a similar object (e.g., striped sock) than when they had not described a similar object. Two physical cues—the background that framed the to‐be‐described pictures and the position of the pictures in the display—were manipulated to alter perceptions about the relevant discourse context. We measured the rate with which speakers modify referring expressions to differentiate current from past referents. Recognition memory measures following the conversation probed what was and was not remembered about past discourse referents and contexts. Analysis of modification rates indicated that these contextual grouping cues shaped perceptions about the relevant discourse context. The contextual cues did not affect memory for the referents, but the memory for past referents was better for speakers than for listeners. Our findings show that perceptions about the relevant discourse history are a key determinant of how language is used in the moment but also that conversational partners form asymmetric representations of the discourse history.

    

   more » « less
4. Melting Ice With Your Mind: Representational Momentum for Physical States

   https://doi.org/10.1177/09567976211051744  

   Hafri, Alon ; Boger, Tal ; Firestone, Chaz ( April 2022 , Psychological Science)

   When a log burns, it transforms from a block of wood into a pile of ash. Such state changes are among the most dramatic ways objects change, going beyond mere changes of position or orientation. How does the mind represent changes of state? A foundational result in visual cognition is that memory extrapolates the positions of moving objects—a distortion called representational momentum. Here, five experiments ( N = 400 adults) exploited this phenomenon to investigate mental representations in state space. Participants who viewed objects undergoing state changes (e.g., ice melting, logs burning, or grapes shriveling) remembered them as more changed (e.g., more melted, burned, or shriveled) than they actually were. This pattern extended to several types of state changes, went beyond their low-level properties, and even adhered to their natural trajectories in state space. Thus, mental representations of objects actively incorporate how they change—not only in their relation to their environment, but also in their essential qualities.

    

   more » « less
5. Where word and world meet: Language and vision share an abstract representation of symmetry

   Hafri, Alon ; Gleitman, Lila R. ; Landau, Barbara ; Trueswell, John C. ( September 2022 , Journal of experimental psychology)

   Symmetry is ubiquitous in nature, in logic and mathematics, and in perception, language, and thought. Although humans are exquisitely sensitive to visual symmetry (e.g., of a butterfly), symmetry in natural language goes beyond visuospatial properties: many words point to abstract concepts with symmetrical content (e.g., equal, marry). For example, if Mark marries Bill, then Bill marries Mark. In both cases (vision and language), symmetry may be formally characterized as invariance under transformation. Is this a coincidence, or is there some deeper psychological resemblance? Here we asked whether representations of symmetry correspond across language and vision. To do so, we developed a novel cross-modal matching paradigm. On each trial, participants observed a visual stimulus (either symmetrical or nonsymmetrical) and had to choose between a symmetrical and nonsymmetrical English predicate unrelated to the stimulus (e.g., “negotiate” vs. “propose”). In a first study with visual events (symmetrical collision or asymmetrical launch), participants reliably chose the predicate matching the event’s symmetry. A second study showed that this “language-vision correspondence” generalized to objects and was weakened when the stimuli’s binary nature was made less apparent (i.e., for one object, rather than two inward-facing objects). A final study showed the same effect when nonsigners guessed English translations of signs from American Sign Language, which expresses many symmetrical concepts spatially. Taken together, our findings support the existence of an abstract representation of symmetry which humans access via both perceptual and linguistic means. More broadly, this work sheds light on the rich, structured nature of the language-cognition interface. 

   more » « less