skip to main content


Title: Acoustic Pattern Recognition and Courtship Songs: Insights from Insects
Across the animal kingdom, social interactions rely on sound production and perception. From simple cricket chirps to more elaborate bird songs, animals go to great lengths to communicate information critical for reproduction and survival via acoustic signals. Insects produce a wide array of songs to attract a mate, and the intended receivers must differentiate these calls from competing sounds, analyze the quality of the sender from spectrotemporal signal properties, and then determine how to react. Insects use numerically simple nervous systems to analyze and respond to courtship songs, making them ideal model systems for uncovering the neural mechanisms underlying acoustic pattern recognition. We highlight here how the combination of behavioral studies and neural recordings in three groups of insects—crickets, grasshoppers, and fruit flies—reveals common strategies for extracting ethologically relevant information from acoustic patterns and how these findings might translate to other systems.  more » « less
Award ID(s):
1734030
NSF-PAR ID:
10169911
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Annual Review of Neuroscience
Volume:
42
Issue:
1
ISSN:
0147-006X
Page Range / eLocation ID:
129 to 147
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Most commercial music services rely on collaborative filtering to recommend artists and songs. While this method is effective for popular artists with large fanbases, it can present difficulties for recommending novel, lesser known artists due to a relative lack of user preference data. In this paper, we therefore seek to understand how content-based approaches can be used to more effectively recommend songs from these lesser known artists. Specifically, we conduct a user study to answer three questions. Firstly, do most users agree which songs are most acoustically similar? Secondly, is acoustic similarity a good proxy for how an individual might construct a playlist or recommend music to a friend? Thirdly, if so, can we find acoustic features that are related to human judgments of acoustic similarity? To answer these questions, our study asked 117 test subjects to compare two unknown candidate songs relative to a third known reference song. Our findings show that 1) judgments about acoustic similarity are fairly consistent, 2) acoustic similarity is highly correlated with playlist selection and recommendation, but not necessarily personal preference, and 3) we identify a subset of acoustic features from the Spotify Web API that is particularly predictive of human similarity judgments. 
    more » « less
  2. This study focuses on the genusDioncomenaand its acoustics, particularly the unique songs produced by maleDioncomenathat consist of several distinct elements in a fixed sequence, culminating in a coda that typically elicits a response from a receptive female. We also examine the inflated pronotal lobes, which we term prebullae, that are prominently developed in someDioncomenaspecies but not in others. We discuss the role of prebullae in the context of acoustic communication inDioncomenaand other related Phaneropterini genera that have similar lateral pronotal lobes. We found that prebullae size is correlated with habitat distribution, with larger prebullae occurring in isolated species while aggregation-prone species have smaller or less pronounced prebullae. Using micro-computer tomography we show sexual dimorphism in the 3D geometry of the acoustic tracheae, being larger in the male. Interestingly, the tracheae are coupled by a septum, like in field crickets, which suggests potential cross talk.

    We define three groups ofDioncomenabased on altitude preferences, ecology, color patterns, and songs: thejagoi-,tanneri-, andornata-groups. We describe the songs of several species, including newly identified species such asD. flavoviridissp. nov.,D. magomberasp. nov.,D. ngurumontanasp. nov.,D. sanjesp. nov.,D. tanneri,D. versicolorsp. nov., andD. zernyi. We also provide information on the nymphs, development time, and mating behavior of various species reared in the laboratory, shedding light on their phenology and adaptations to their habitats.

     
    more » « less
  3. Traditional models of motor control typically operate in the domain of continuous signals such as spike rates, forces, and kinematics. However, there is growing evidence that precise spike timings encode significant information that coordinates and causally influences motor control. Some existing neural network models incorporate spike timing precision but they neither predict motor spikes coordinated across multiple motor units nor capture sensory-driven modulation of agile locomotor control. In this paper, we propose a visual encoder and model of a sensorimotor system based on a recurrent neural network (RNN) that utilizes spike timing encoding during smooth pursuit target tracking. We use this to predict a nearly complete, spike-resolved motor program of a hawkmoth that requires coordinated millisecond precision across 10 major flight motor units. Each motor unit enervates one muscle and utilizes both rate and timing encoding. Our model includes a motion detection mechanism inspired by the hawkmoth's compound eye, a convolutional encoder that compresses the sensory input, and a simple RNN that is sufficient to sequentially predict wingstroke-to-wingstroke modulation in millisecond-precise spike timings. The two-layer output architecture of the RNN separately predicts the occurrence and timing of each spike in the motor program. The dataset includes spikes recorded from all motor units during a tethered flight where the hawkmoth attends to a moving robotic flower, with a total of roughly 7000 wingstrokes from 16 trials on 5 hawkmoth subjects. Intra-trial and same-subject inter-trial predictions on the test data show that nearly every spike can be predicted within 2 ms of its known spike timing precision values. Whereas, spike occurrence prediction accuracy is about 90%. Overall, our model can predict the precise spike timing of a nearly complete motor program for hawkmoth flight with a precision comparable to that seen in agile flying insects. Such an encoding framework that captures visually-modulated precise spike timing codes and coordination can reveal how organisms process visual cues for agile movements. It can also drive the next generation of neuromorphic controllers for navigation in complex environments. 
    more » « less
  4. Many social animals can recognize other individuals by their vocalizations. This requires a memory system capable of mapping incoming acoustic signals to one of many known individuals. Using the zebra finch, a social songbird that uses songs and distance calls to communicate individual identity (Elie and Theunissen, 2018), we tested the role of two cortical-like brain regions in a vocal recognition task. We found that the rostral region of the Cadomedial Nidopallium (NCM), a secondary auditory region of the avian pallium, was necessary for maintaining auditory memories for conspecific vocalizations in both male and female birds, whereas HVC (used as a proper name), a premotor areas that gates auditory input into the vocal motor and song learning pathways in male birds (Roberts and Mooney, 2013), was not. Both NCM and HVC have previously been implicated for processing the tutor song in the context of song learning (Sakata and Yazaki-Sugiyama, 2020). Our results suggest that NCM might not only store songs as templates for future vocal imitation but also songs and calls for perceptual discrimination of vocalizers in both male and female birds. NCM could therefore operate as a site for auditory memories for vocalizations used in various facets of communication. We also observed that new auditory memories could be acquired without intact HVC or NCM but that for these new memories NCM lesions caused deficits in either memory capacity or auditory discrimination. These results suggest that the high-capacity memory functions of the avian pallial auditory system depend on NCM.

    SIGNIFICANCE STATEMENTMany aspects of vocal communication require the formation of auditory memories. Voice recognition, for example, requires a memory for vocalizers to identify acoustical features. In both birds and primates, the locus and neural correlates of these high-level memories remain poorly described. Previous work suggests that this memory formation is mediated by high-level sensory areas, not traditional memory areas such as the hippocampus. Using lesion experiments, we show that one secondary auditory brain region in songbirds that had previously been implicated in storing song memories for vocal imitation is also implicated in storing vocal memories for individual recognition. The role of the neural circuits in this region in interpreting the meaning of communication calls should be investigated in the future.

     
    more » « less
  5. In many vertebrates, courtship occurs through the performance of elaborate behavioral displays that are as spectacular as they are complex. The question of how sexual selection acts upon these animals’ neuromuscular systems to transform a repertoire of pre-existing movements into such remarkable (if not unusual) display routines has received relatively little research attention. This is a surprising gap in knowledge, given that unraveling this extraordinary process is central to understanding the evolution of behavioral diversity and its neural control. In many vertebrates, courtship displays often push the limits of neuromuscular performance, and often in a ritualized manner. These displays can range from songs that require rapid switching between two independently controlled ‘voice boxes’ to precisely choreographed acrobatics. Here, we propose a framework for thinking about how the brain might not only control these displays, but also shape their evolution. Our framework focuses specifically on a major midbrain area, which we view as a likely important node in the orchestration of the complex neural control of behavior used in the courtship process. This area is the periaqueductal grey (PAG), as studies suggest that it is both necessary and sufficient for the production of many instinctive survival behaviors, including courtship vocalizations. Thus, we speculate about why the PAG, as well as its key inputs, might serve as targets of sexual selection for display behavior. In doing so, we attempt to combine core ideas about the neural control of behavior with principles of display evolution. Our intent is to spur research in this area and bring together neurobiologists and behavioral ecologists to more fully understand the role that the brain might play in behavioral innovation and diversification. 
    more » « less