skip to main content

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Bio-inspired “Self-denoising” capability of 2D materials incorporated optoelectronic synaptic array
Abstract

In in-sensor image preprocessing, the sensed image undergoes low level processing like denoising at the sensor end, similar to the retina of human eye. Optoelectronic synapse devices are potential contenders for this purpose, and subsequent applications in artificial neural networks (ANNs). The optoelectronic synapses can offer image pre-processing functionalities at the pixel itself—termed as in-pixel computing. Denoising is an important problem in image preprocessing and several approaches have been used to denoise the input images. While most of those approaches require external circuitry, others are efficient only when the noisy pixels have significantly lower intensity compared to the actual pattern pixels. In this work, we present the innate ability of an optoelectronic synapse array to perform denoising at the pixel itself once it is trained to memorize an image. The synapses consist of phototransistors with bilayer MoS2channel and p-Si/PtTe2buried gate electrode. Our 7 × 7 array shows excellent robustness to noise due to the interplay between long-term potentiation and short-term potentiation. This bio-inspired strategy enables denoising of noise with higher intensity than the memorized pattern, without the use of any external circuitry. Specifically, due to the ability of these synapses to respond distinctively to wavelengths from 300 nm in ultraviolet to 2 µm in infrared, the pixel array also denoises mixed-color interferences. The “self-denoising” capability of such an artificial visual array has the capacity to eliminate the need for raw data transmission and thus, reduce subsequent image processing steps for supervised learning.

  more » « less
PAR ID:
10495433
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
npj 2D Materials and Applications
Volume:
8
Issue:
1
ISSN:
2397-7132
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , Scientific Reports)
    null (Ed.)
    Abstract Optical data sensing, processing and visual memory are fundamental requirements for artificial intelligence and robotics with autonomous navigation. Traditionally, imaging has been kept separate from the pattern recognition circuitry. Optoelectronic synapses hold the special potential of integrating these two fields into a single layer, where a single device can record optical data, convert it into a conductance state and store it for learning and pattern recognition, similar to the optic nerve in human eye. In this work, the trapping and de-trapping of photogenerated carriers in the MoS 2 /SiO 2 interface of a n-channel MoS 2 transistor was employed to emulate the optoelectronic synapse characteristics. The monolayer MoS 2 field effect transistor (FET) exhibits photo-induced short-term and long-term potentiation, electrically driven long-term depression, paired pulse facilitation (PPF), spike time dependent plasticity, which are necessary synaptic characteristics. Moreover, the device’s ability to retain its conductance state can be modulated by the gate voltage, making the device behave as a photodetector for positive gate voltages and an optoelectronic synapse at negative gate voltages. 
    more » « less
  2. ; ; ; ; ( , Advanced Optical Materials)
    Abstract

    In‐sensor computing is an emerging architectural paradigm that fuses data acquisition and processing within a sensory domain. The integration of multiple functions into a single domain reduces the system footprint while it minimizes the energy and time for data transfer between sensory and computing units. However, it is challenging for a simple and compact image sensor array to achieve both sensing and computing in each pixel. Here, this work demonstrates a focal plane array with a heterogeneously integrated one‐photodiode one‐resistor (1P‐1R)‐based artificial optical neuron that emulates the sensing, computing, and memorization of a biological retina system. This work employs an InGaAs photodiode featuring a high responsivity and a broad spectrum that covers near‐infrared (NIR) signals and employs an HfO2memristor as the artificial synapse to achieve the computing/memorization in an analog domain. Using the fabricated focal plane array integrated with an artificial neural network, this work performs in‐sensor image identification of finger veins driven by NIR light illumination (≈84 % accuracy). The proposed in‐sensor image computing architecture that broadly covers the NIR spectrum offers widespread application of focal plane array for computer vision, neuromorphic computing, biomedical engineering, etc.

     
    more » « less
  3. ; ; ; ( , Scientific Reports)
    Abstract

    Optoelectronic synapses combine the functionalities of a non-volatile memory and photodetection in the same device, paving the path for the realization of artificial retina systems which can capture, pre-process, and identify images on the same platform. Graphene/Ta2O5/graphene phototransistor exhibits synapse characteristics when visible electromagnetic radiation of wavelength 405 nm illuminates the device. The photocurrent is retained after light withdrawal when positive gate voltage is applied to the device. The device exhibits distinct conductance states, modulated by different parameters of incident light, such as pulse width and number of pulses. The conductance state can be retained for 104 s, indicating long term potentiation (LTP), similar to biological synapses. By using optical and electrical pulses, the device shows optical potentiation and electrical LTD repeatably, implying their applicability in neural networks for pattern recognition.

     
    more » « less
  4. ; ; ( , Applied Physics Letters)

    Resistive switching is a promising technology for artificial synapses, the most critical component and building block of a neural network for brain-inspired neuromorphic computing. The artificial synapse is capable of emulating a signal process and memory functions of biological synapses. The artificial synapse fabricated by natural bioorganic materials is essential for developing soft, flexible, and biocompatible electronics and sustainable, biodegradable, and environmentally friendly neuromorphic systems. In this work, a natural biomaterial—honey based resistive switching device—was demonstrated to emulate some important functionalities of biological synapses, including synaptic potentiation and depression, short-term and long-term memory, spatial summation, and shunting inhibition. The results indicate the potential of honey based resistive switching for artificial synaptic devices in renewable neuromorphic systems and bioelectronics.

     
    more » « less
  5. ; ; ; ; ; ; ( , Nature Communications)
    Abstract

    CMOS-based computing systems that employ the von Neumann architecture are relatively limited when it comes to parallel data storage and processing. In contrast, the human brain is a living computational signal processing unit that operates with extreme parallelism and energy efficiency. Although numerous neuromorphic electronic devices have emerged in the last decade, most of them are rigid or contain materials that are toxic to biological systems. In this work, we report on biocompatible bilayer graphene-based artificial synaptic transistors (BLAST) capable of mimicking synaptic behavior. The BLAST devices leverage a dry ion-selective membrane, enabling long-term potentiation, with ~50 aJ/µm2switching energy efficiency, at least an order of magnitude lower than previous reports on two-dimensional material-based artificial synapses. The devices show unique metaplasticity, a useful feature for generalizable deep neural networks, and we demonstrate that metaplastic BLASTs outperform ideal linear synapses in classic image classification tasks. With switching energy well below the 1 fJ energy estimated per biological synapse, the proposed devices are powerful candidates for bio-interfaced online learning, bridging the gap between artificial and biological neural networks.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email