skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Deep Learning Approach for High-accuracy Electron Counting of Monolithic Active Pixel Sensor-type Direct Electron Detectors at Increased Electron Dose
Abstract Electron counting can be performed algorithmically for monolithic active pixel sensor direct electron detectors to eliminate readout noise and Landau noise arising from the variability in the amount of deposited energy for each electron. Errors in existing counting algorithms include mistakenly counting a multielectron strike as a single electron event, and inaccurately locating the incident position of the electron due to lateral spread of deposited energy and dark noise. Here, we report a supervised deep learning (DL) approach based on Faster region-based convolutional neural network (R-CNN) to recognize single electron events at varying electron doses and voltages. The DL approach shows high accuracy according to the near-ideal modulation transfer function (MTF) and detector quantum efficiency for sparse images. It predicts, on average, 0.47 pixel deviation from the incident positions for 200 kV electrons versus 0.59 pixel using the conventional counting method. The DL approach also shows better robustness against coincidence loss as the electron dose increases, maintaining the MTF at half Nyquist frequency above 0.83 as the electron density increases to 0.06 e−/pixel. Thus, the DL model extends the advantages of counting analysis to higher dose rates than conventional methods.  more » « less
Award ID(s):
1931298
PAR ID:
10501117
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Microscopy and Microanalysis
Volume:
29
Issue:
6
ISSN:
1431-9276
Page Range / eLocation ID:
2026 to 2036
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Precision and accuracy of quantitative scanning transmission electron microscopy (STEM) methods such as ptychography, and the mapping of electric, magnetic, and strain fields depend on the dose. Reasonable acquisition time requires high beam current and the ability to quantitatively detect both large and minute changes in signal. A new hybrid pixel array detector (PAD), the second-generation Electron Microscope Pixel Array Detector (EMPAD-G2), addresses this challenge by advancing the technology of a previous generation PAD, the EMPAD. The EMPAD-G2 images continuously at a frame-rates up to 10 kHz with a dynamic range that spans from low-noise detection of single electrons to electron beam currents exceeding 180 pA per pixel, even at electron energies of 300 keV. The EMPAD-G2 enables rapid collection of high-quality STEM data that simultaneously contain full diffraction information from unsaturated bright-field disks to usable Kikuchi bands and higher-order Laue zones. Test results from 80 to 300 keV are presented, as are first experimental results demonstrating ptychographic reconstructions, strain and polarization maps. We introduce a new information metric, the maximum usable imaging speed (MUIS), to identify when a detector becomes electron-starved, saturated or its pixel count is mismatched with the beam current. 
    more » « less
  2. Modern science is dependent on imaging on the nanoscale, often achieved through processes that detect secondary electrons created by a highly focused incident charged particle beam. Multiple types of measurement noise limit the ultimate trade-off between the image quality and the incident particle dose, which can preclude useful imaging of dose-sensitive samples. Existing methods to improve image quality do not fundamentally mitigate the noise sources. Furthermore, barriers to assigning a physically meaningful scale make the images qualitative. Here, we introduce ion count-aided microscopy (ICAM), which is a quantitative imaging technique that uses statistically principled estimation of the secondary electron yield. With a readily implemented change in data collection, ICAM substantially reduces source shot noise. In helium ion microscopy, we demonstrate 3 × dose reduction and a good match between these empirical results and theoretical performance predictions. ICAM facilitates imaging of fragile samples and may make imaging with heavier particles more attractive. 
    more » « less
  3. Abstract Both high resolution and high precision are required to quantitatively determine the atomic structure of complex nanostructured materials. However, for conventional imaging methods in scanning transmission electron microscopy (STEM), atomic resolution with picometer precision cannot usually be achieved for weakly-scattering samples or radiation-sensitive materials, such as 2D materials. Here, we demonstrate low-dose, sub-angstrom resolution imaging with picometer precision using mixed-state electron ptychography. We show that correctly accounting for the partial coherence of the electron beam is a prerequisite for high-quality structural reconstructions due to the intrinsic partial coherence of the electron beam. The mixed-state reconstruction gains importance especially when simultaneously pursuing high resolution, high precision and large field-of-view imaging. Compared with conventional atomic-resolution STEM imaging techniques, the mixed-state ptychographic approach simultaneously provides a four-times-faster acquisition, with double the information limit at the same dose, or up to a fifty-fold reduction in dose at the same resolution. 
    more » « less
  4. Abstract High energy resolution DEMETER satellite observations from the Instrument for the Detection of Particle (IDP) are analyzed during an electromagnetic ion cyclotron (EMIC)‐induced electron precipitation event. Analysis of an Interval Pulsation with Diminishing Periods (IPDP)‐type EMIC wave event, using combined satellite observations to correct for incident proton contamination, detected an energy precipitation spectrum ranging from ∼150 keV to ∼1.5 MeV. While inconsistent with many theoretical predictions of >1 MeV EMIC‐induced electron precipitation, the finding is consistent with an increasing number of experimentally observed events detected using lower resolution integral channel measurements on the POES, FIREBIRD, and ELFIN satellites. Revised and improved DEMETER differential energy fluxes, after correction for incident proton contamination shows that they agree to within 40% in peak flux magnitude, and 85 keV (within 40%) for the energy at which the peak occurred as calculated from POES integral channel electron precipitation measurements. This work shows that a subset of EMIC waves found close to the plasmapause, that is, IPDP‐type rising tone events, can produce electron precipitation with peak energies substantially below 1 MeV. The rising tone features of IPDP EMIC waves, along with the association with the high cold plasma density regime, and the rapidly varying electron density gradients of the plasmapause may be an important factor in the generation of such low energy precipitation, co‐incident with a high energy tail. Our work highlights the importance of undertaking proton contamination correction when using the high‐resolution DEMETER particle measurements to investigate EMIC‐driven electron precipitation. 
    more » « less
  5. Abstract The ability to probe and control matter at the picometer scale is essential for advancing quantum and energy technologies. Scanning transmission electron microscopy offers powerful capabilities for materials analysis and modification, but sample damage, drift, and scan distortions hinder single atom analysis and deterministic manipulation. Materials analysis and modification via electron–solid interactions can be transformed by precise delivery of electrons to a specified atomic location, maintaining the beam position despite drift, and minimizing collateral dose. Here a fast, low‐dose, sub‐20‐pm precision electron beam positioning technique is developed, “atomic lock‐on,” (ALO), which offers the ability to position the beam on a specific atomic columnwithoutpreviously irradiating that column. This technique is used to lock onto a single selected atomic location to repeatedly measure its weak electron energy loss signal despite sample drift. Moreover, electron beam‐matter interactions in single atomic events are measured with time resolution. This enables observation of single‐atom dynamics, such as atomic bistability, revealing partially bonded atomic configurations and recapture phenomena. This opens prospects for using electron microscopy for high‐precision measurements and deterministic control of matter for quantum technologies. 
    more » « less