skip to main content

Explore Research Products in the NSF-PAR

Title: Bio-inspired “Self-denoising” capability of 2D materials incorporated optoelectronic synaptic array
Abstract

In in-sensor image preprocessing, the sensed image undergoes low level processing like denoising at the sensor end, similar to the retina of human eye. Optoelectronic synapse devices are potential contenders for this purpose, and subsequent applications in artificial neural networks (ANNs). The optoelectronic synapses can offer image pre-processing functionalities at the pixel itself—termed as in-pixel computing. Denoising is an important problem in image preprocessing and several approaches have been used to denoise the input images. While most of those approaches require external circuitry, others are efficient only when the noisy pixels have significantly lower intensity compared to the actual pattern pixels. In this work, we present the innate ability of an optoelectronic synapse array to perform denoising at the pixel itself once it is trained to memorize an image. The synapses consist of phototransistors with bilayer MoS2channel and p-Si/PtTe2buried gate electrode. Our 7 × 7 array shows excellent robustness to noise due to the interplay between long-term potentiation and short-term potentiation. This bio-inspired strategy enables denoising of noise with higher intensity than the memorized pattern, without the use of any external circuitry. Specifically, due to the ability of these synapses to respond distinctively to wavelengths from 300 nm in ultraviolet to 2 µm in infrared, the pixel array also denoises mixed-color interferences. The “self-denoising” capability of such an artificial visual array has the capacity to eliminate the need for raw data transmission and thus, reduce subsequent image processing steps for supervised learning.

  more » « less
NSF-PAR ID:
10495433
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
npj 2D Materials and Applications
Volume:
8
Issue:
1
ISSN:
2397-7132
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , Scientific Reports)
    null (Ed.)
    Abstract Optical data sensing, processing and visual memory are fundamental requirements for artificial intelligence and robotics with autonomous navigation. Traditionally, imaging has been kept separate from the pattern recognition circuitry. Optoelectronic synapses hold the special potential of integrating these two fields into a single layer, where a single device can record optical data, convert it into a conductance state and store it for learning and pattern recognition, similar to the optic nerve in human eye. In this work, the trapping and de-trapping of photogenerated carriers in the MoS 2 /SiO 2 interface of a n-channel MoS 2 transistor was employed to emulate the optoelectronic synapse characteristics. The monolayer MoS 2 field effect transistor (FET) exhibits photo-induced short-term and long-term potentiation, electrically driven long-term depression, paired pulse facilitation (PPF), spike time dependent plasticity, which are necessary synaptic characteristics. Moreover, the device’s ability to retain its conductance state can be modulated by the gate voltage, making the device behave as a photodetector for positive gate voltages and an optoelectronic synapse at negative gate voltages. 
    more » « less
  2. ; ; ; ( , Scientific Reports)
    Abstract

    Optoelectronic synapses combine the functionalities of a non-volatile memory and photodetection in the same device, paving the path for the realization of artificial retina systems which can capture, pre-process, and identify images on the same platform. Graphene/Ta2O5/graphene phototransistor exhibits synapse characteristics when visible electromagnetic radiation of wavelength 405 nm illuminates the device. The photocurrent is retained after light withdrawal when positive gate voltage is applied to the device. The device exhibits distinct conductance states, modulated by different parameters of incident light, such as pulse width and number of pulses. The conductance state can be retained for 104 s, indicating long term potentiation (LTP), similar to biological synapses. By using optical and electrical pulses, the device shows optical potentiation and electrical LTD repeatably, implying their applicability in neural networks for pattern recognition.

     
    more » « less
  3. ; ; ; ; ( , Advanced Optical Materials)
    Abstract

    In‐sensor computing is an emerging architectural paradigm that fuses data acquisition and processing within a sensory domain. The integration of multiple functions into a single domain reduces the system footprint while it minimizes the energy and time for data transfer between sensory and computing units. However, it is challenging for a simple and compact image sensor array to achieve both sensing and computing in each pixel. Here, this work demonstrates a focal plane array with a heterogeneously integrated one‐photodiode one‐resistor (1P‐1R)‐based artificial optical neuron that emulates the sensing, computing, and memorization of a biological retina system. This work employs an InGaAs photodiode featuring a high responsivity and a broad spectrum that covers near‐infrared (NIR) signals and employs an HfO2memristor as the artificial synapse to achieve the computing/memorization in an analog domain. Using the fabricated focal plane array integrated with an artificial neural network, this work performs in‐sensor image identification of finger veins driven by NIR light illumination (≈84 % accuracy). The proposed in‐sensor image computing architecture that broadly covers the NIR spectrum offers widespread application of focal plane array for computer vision, neuromorphic computing, biomedical engineering, etc.

     
    more » « less
  4. ; ; ; ; ; ; ( , Nature Communications)
    Abstract

    CMOS-based computing systems that employ the von Neumann architecture are relatively limited when it comes to parallel data storage and processing. In contrast, the human brain is a living computational signal processing unit that operates with extreme parallelism and energy efficiency. Although numerous neuromorphic electronic devices have emerged in the last decade, most of them are rigid or contain materials that are toxic to biological systems. In this work, we report on biocompatible bilayer graphene-based artificial synaptic transistors (BLAST) capable of mimicking synaptic behavior. The BLAST devices leverage a dry ion-selective membrane, enabling long-term potentiation, with ~50 aJ/µm2switching energy efficiency, at least an order of magnitude lower than previous reports on two-dimensional material-based artificial synapses. The devices show unique metaplasticity, a useful feature for generalizable deep neural networks, and we demonstrate that metaplastic BLASTs outperform ideal linear synapses in classic image classification tasks. With switching energy well below the 1 fJ energy estimated per biological synapse, the proposed devices are powerful candidates for bio-interfaced online learning, bridging the gap between artificial and biological neural networks.

     
    more » « less
  5. ; ( , Advanced Electronic Materials)

    New parallel computing architectures based on neuromorphic computing are needed due to their advantages over conventional computation with regards to real‐time processing of unstructured sensory data such as image, video, or voice. However, developing artificial neuromorphic system remains a challenge due to the lack of electronic synaptic devices, which can mimic all the functions of biological synapses with low energy consumption. Here it is reported that two‐terminal organometal trihalide perovskite (OTP) synaptic devices can mimic the neuromorphic learning and remembering process. Various functions known in biological synapses are demonstrated in OTP synaptic devices including four forms of spike‐timing‐dependent plasticity (STDP), spike‐rate‐dependent plasticity (SRDP), short‐term plasticity (STP) and long‐term potentiation (LTP)), and learning‐experience behavior. The excellent photovoltaic property of the OTP devices also enables photo‐read synaptic functions. The perovskite synapse has the potential of low energy consumption of femto‐Joule/(100 nm)2per event, which is close to the energy consumption of biological synapses. The demonstration of energy‐efficient OTP synaptic devices opens a new plausible application of OTP materials into neuromorphic devices, which offer the high connectivity and high density required for biomimic computing.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email