skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: High-flux single-photon lidar
In time-correlated single-photon counting (TCSPC), photons that arrive during the detector and timing electronics dead times are missed, causing distortion of the detection time distribution. Conventional wisdom holds that TCSPC should be performed with detections in fewer than 5% of illumination cycles to avoid substantial distortion. This requires attenuation and leads to longer acquisition times if the incident flux is too high. Through the example of ranging with a single-photon lidar system, this work demonstrates that accurately modeling the sequence of detection times as a Markov chain allows for measurements at much higher incident flux without attenuation. Our probabilistic model is validated by the close match between the limiting distribution of the Markov chain and both simulated and experimental data, so long as issues of calibration and afterpulsing are minimal. We propose an algorithm that corrects for the distortion in detection histograms caused by dead times without assumptions on the form of the transient light intensity. Our histogram correction yields substantially improved depth imaging performance, and modest additional improvement is achieved with a parametric model assuming a single depth per pixel. We show results for depth and flux estimation with up to 5 photoelectrons per illumination cycle on average, facilitating an increase in time efficiency of more than two orders of magnitude. The use of identical TCSPC equipment in other fields suggests that our modeling and histogram correction could likewise enable high-flux acquisitions in fluorescence lifetime microscopy or quantum optics applications.  more » « less
Award ID(s):
1815896 1422034
PAR ID:
10208807
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Optica
Volume:
8
Issue:
1
ISSN:
2334-2536
Format(s):
Medium: X Size: Article No. 30
Size(s):
Article No. 30
Sponsoring Org:
National Science Foundation
More Like this
  1. Time-correlated single-photon counting (TCSPC) is an enabling technology for applications such as low-light fluorescence lifetime microscopy and photon counting time-of-flight (ToF) 3D imaging. However, state-of-the-art TCSPC single-photon timing resolution (SPTR) is limited to 3–100 ps by single-photon detectors. Here, we experimentally demonstrate a time-magnified TCSPC (TM-TCSPC) that achieves an ultrashort SPTR of 550 fs with an off-the-shelf single-photon detector. The TM-TCSPC can resolve ultrashort pulses with a 130-fs pulse width difference at a 22-fs accuracy. When applied to photon counting ToF 3D imaging, the TM-TCSPC greatly suppresses the range walk error that limits all photon counting ToF 3D imaging systems by 99.2% and thus provides high depth accuracy and precision of 26 µm and 3 µm, respectively. 
    more » « less
  2. Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination — electronic noise dominates under low illumination, and pixel full-well capacity results in saturation under bright illumination. We propose a novel intensity cue based on measuring inter-photon timing, defined as the time delay between detection of successive photons. Based on the statistics of inter-photon times measured by a time-resolved single-photon sensor, we develop theory and algorithms for a scene brightness estimator which works over extreme dynamic range; we experimentally demonstrate imaging scenes with a dynamic range of over ten million to one. The proposed techniques, aided by the emergence of single-photon sensors such as single-photon avalanche diodes (SPADs) with picosecond timing resolution, will have implications for a wide range of imaging applications: robotics, consumer photography, astronomy, microscopy and biomedical imaging. 
    more » « less
  3. Single-photon lidar (SPL) is a promising technology for depth measurement at long range or from weak reflectors because of the sensitivity to extremely low light levels. However, constraints on the timing resolution of existing arrays of single-photon avalanche diode (SPAD) detectors limit the precision of resulting depth estimates. In this work, we describe an implementation of subtractively-dithered SPL that can recover high-resolution depth estimates despite the coarse resolution of the detector. Subtractively-dithered measurement is achieved by adding programmable delays into the photon timing circuitry that introduce relative time shifts between the illumination and detection that are shorter than the time bin duration. Careful modeling of the temporal instrument response function leads to an estimator that outperforms the sample mean and results in depth estimates with up to 13 times lower root mean-squared error than if dither were not used. The simple implementation and estimation suggest that globally dithered SPAD arrays could be used for high spatial- and temporal-resolution depth sensing. 
    more » « less
  4. Optical projection tomography (OPT) is a powerful imaging modality for attaining high resolution absorption and fluorescence imaging in tissue samples and embryos with a diameter of roughly 1 mm. Moving past this 1 mm limit, scattered light becomes the dominant fraction detected, adding significant “blur” to OPT. Time-domain OPT has been used to select out early-arriving photons that have taken a more direct route through the tissue to reduce detection of scattered photons in these larger samples, which are the cause of image domain blur1. In addition, it was recently demonstrated by our group that detection of scattered photons could be further depressed by running in a “deadtime” regime where laser repetition rates are selected such that the deadtime incurred by early-arriving photons acts as a shutter to later-arriving scattered photons2. By running in this deadtime regime, far greater early photon count rates are achievable than with standard early photon OPT. In this work, another advantage of this enhanced early photon collection approach is demonstrated: specifically, a significant improvement in signal-to-noise ratio. In single photon counting detectors, the main source of noise is “afterpulsing,” which is essentially leftover charge from a detected photon that spuriously results in a second photon count. When the arrival of the photons are time-stamped by the time correlated single photon counting (TCSPC) module , the rate constant governing afterpusling is slow compared to the time-scale of the light pulse detected so it is observed as a background signal with very little time-correlation. This signal is present in all time-gates and so adds noise to the detection of early photons. However, since the afterpusling signal is proportional to the total rate of photon detection, our enhanced early photon approach is uniquely able to have increased early photon counts with no appreciable increase in the afterpulsing since overall count-rate does not change. This is because as the rate of early photon detection goes up, the rate of late-photon detection reduces commensurately, yielding no net change in the overall rate of photons detected. This hypothesis was tested on a 4 mm diameter tissue-mimicking phantom (μa = 0.02 mm-1, μs’ = 1 mm-1) by ranging the power of a 10 MHz pulse 780-nm laser with pulse spread of < 100 fs (Calmar, USA) and an avalanche photodiode (MPD, Picoquant, Germany) and TCSPC module (HydraHarp, Picoquant, Germany) for light detection. Details of the results are in Fig. 1a, but of note is that we observed more than a 60-times improvement in SNR compared to conventional early photon detection that would have taken 1000-times longer to achieve the same early photon count. A demonstration of the type of resolution possible is in Fig 1b with an image of a 4-mm-thick human breast cancer biopsy where tumor spiculations of less than 100 μm diameter are observable. 1Fieramonti, L. et al. PloS one (2012). 2Sinha, L., et al. Optics letters (2016). 
    more » « less
  5. Single-photon 3D cameras can record the time of arrival of billions of photons per second with picosecond accuracy. One common approach to summarize the photon data stream is to build a per-pixel timestamp histogram, resulting in a 3D histogram tensor that encodes distances along the time axis. As the spatio-temporal resolution of the histogram tensor increases, the in-pixel memory requirements and output data rates can quickly become impractical. To overcome this limitation, we propose a family of linear compressive representations of histogram tensors that can be computed efficiently, in an online fashion, as a matrix operation. We design practical lightweight compressive representations that are amenable to an in-pixel implementation and consider the spatio-temporal information of each timestamp. Furthermore, we implement our proposed framework as the first layer of a neural network, which enables the joint end-to-end optimization of the compressive representations and a downstream SPAD data processing model. We find that a well-designed compressive representation can reduce in-sensor memory and data rates up to 2 orders of magnitude without significantly reducing 3D imaging quality. Finally, we analyze the power consumption implications through an on-chip implementation. 
    more » « less