skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Neuromorphic principles for machine olfaction
Abstract Neuromorphic computing, exemplified by breakthroughs in machine vision through concepts like address-event representation and send-on-delta sampling, has revolutionised sensor technology, enabling low-latency and high dynamic range perception with minimal bandwidth. While these advancements are prominent in vision and auditory perception, their potential in machine olfaction remains under-explored, particularly in the context of fast sensing. Here, we outline the perspectives for neuromorphic principles in machine olfaction. Considering the physical characteristics of turbulent odour environments, we argue that event-driven signal processing is optimally suited to the inherent properties of olfactory signals. We highlight the lack of bandwidth limitation due to turbulent dispersal processes, the characteristic temporal and chemical sparsity, as well as the high information density of the odour landscape. Further, we critically review and discuss the literature on neuromorphic olfaction; particularly focusing on neuromorphic principles such as event generation algorithms, information encoding mechanisms, event processing schemes (spiking neural networks), and learning. We discuss that the application of neuromorphic principles may significantly enhance response time and task performance in robotic olfaction, enabling autonomous systems to perform complex tasks in turbulent environments—such as environmental monitoring, odour guided search and rescue operations, and hazard detection.  more » « less
Award ID(s):
2014217
PAR ID:
10587995
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Neuromorphic Computing and Engineering
Volume:
5
Issue:
2
ISSN:
2634-4386
Format(s):
Medium: X Size: Article No. 023001
Size(s):
Article No. 023001
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract The sense of smell is an essential modality for many species, in particular nocturnal and crepuscular mammals, to gather information about their environment. Olfactory cues provide information over a large range of distances, allowing behaviours ranging from simple detection and recognition of objects, to tracking trails and navigating using odour plumes from afar. In this review, we discuss the features of the natural olfactory environment and provide a brief overview of how odour information can be sampled and might be represented and processed by the mammalian olfactory system. Finally, we discuss recent behavioural approaches that address how mammals extract spatial information from the environment in three different contexts: odour trail tracking, odour plume tracking and, more general, olfactory-guided navigation. Recent technological developments have seen the spatiotemporal aspect of mammalian olfaction gain significant attention, and we discuss both the promising aspects of rapidly developing paradigms and stimulus control technologies as well as their limitations. We conclude that, while still in its beginnings, research on the odour environment offers an entry point into understanding the mechanisms how mammals extract information about space. 
    more » « less
  2. Abstract In recent years, there has been a growing demand for miniaturization, low power consumption, quick treatments, and non-invasive clinical strategies in the healthcare industry. To meet these demands, healthcare professionals are seeking new technological paradigms that can improve diagnostic accuracy while ensuring patient compliance. Neuromorphic engineering, which uses neural models in hardware and software to replicate brain-like behaviors, can help usher in a new era of medicine by delivering low power, low latency, small footprint, and high bandwidth solutions. This paper provides an overview of recent neuromorphic advancements in medicine, including medical imaging and cancer diagnosis, processing of biosignals for diagnosis, and biomedical interfaces, such as motor, cognitive, and perception prostheses. For each section, we provide examples of how brain-inspired models can successfully compete with conventional artificial intelligence algorithms, demonstrating the potential of neuromorphic engineering to meet demands and improve patient outcomes. Lastly, we discuss current struggles in fitting neuromorphic hardware with non-neuromorphic technologies and propose potential solutions for future bottlenecks in hardware compatibility. 
    more » « less
  3. Abstract Microelectronic computers have encountered challenges in meeting all of today’s demands for information processing. Meeting these demands will require the development of unconventional computers employing alternative processing models and new device physics. Neural network models have come to dominate modern machine learning algorithms, and specialized electronic hardware has been developed to implement them more efficiently. A silicon photonic integration industry promises to bring manufacturing ecosystems normally reserved for microelectronics to photonics. Photonic devices have already found simple analog signal processing niches where electronics cannot provide sufficient bandwidth and reconfigurability. In order to solve more complex information processing problems, they will have to adopt a processing model that generalizes and scales. Neuromorphic photonics aims to map physical models of optoelectronic systems to abstract models of neural networks. It represents a new opportunity for machine information processing on sub-nanosecond timescales, with application to mathematical programming, intelligent radio frequency signal processing, and real-time control. The strategy of neuromorphic engineering is to externalize the risk of developing computational theory alongside hardware. The strategy of remaining compatible with silicon photonics externalizes the risk of platform development. In this perspective article, we provide a rationale for a neuromorphic photonics processor, envisioning its architecture and a compiler. We also discuss how it can be interfaced with a general purpose computer, i.e. a CPU, as a coprocessor to target specific applications. This paper is intended for a wide audience and provides a roadmap for expanding research in the direction of transforming neuromorphic photonics into a viable and useful candidate for accelerating neuromorphic computing. 
    more » « less
  4. Neuromorphic computing systems promise high energy efficiency and low latency. In particular, when integrated with neuromorphic sensors, they can be used to produce intelligent systems for a broad range of applications. An event‐based camera is such a neuromorphic sensor, inspired by the sparse and asynchronous spike representation of the biological visual system. However, processing the event data requires either using expensive feature descriptors to transform spikes into frames, or using spiking neural networks (SNNs) that are expensive to train. In this work, a neural network architecture is proposed, reservoir nodes‐enabled neuromorphic vision sensing network (RN‐Net), based on dynamic temporal encoding by on‐sensor reservoirs and simple deep neural network (DNN) blocks. The reservoir nodes enable efficient temporal processing of asynchronous events by leveraging the native dynamics of the node devices, while the DNN blocks enable spatial feature processing. Combining these blocks in a hierarchical structure, the RN‐Net offers efficient processing for both local and global spatiotemporal features. RN‐Net executes dynamic vision tasks created by event‐based cameras at the highest accuracy reported to date at one order of magnitude smaller network size. The use of simple DNN and standard backpropagation‐based training rules further reduces implementation and training costs. 
    more » « less
  5. Abstract Machine learning‐assisted computer vision represents a state‐of‐the‐art technique for extracting meaningful features from visual data autonomously. This approach facilitates the quantitative analysis of images, enabling object detection and tracking. In this study, we utilize advanced computer vision to precisely identify droplet motions and quantify their impact forces with spatiotemporal resolution at the picoliter or millisecond scale. Droplets, captured by a high‐speed camera, are denoised through neuromorphic image processing. These processed images are employed to train convolutional neural networks, allowing the creation of segmented masks and bounding boxes around moving droplets. The trained networks further digitize time‐varying multi‐dimensional droplet features, such as droplet diameters, spreading and sliding motions, and corresponding impact forces. Our innovative method offers accurate measurement of small impact forces with a resolution of approximately 10 pico‐newtons for droplets in the micrometer range across various configurations with the time resolution at hundreds of microseconds. 
    more » « less