An official website of the United States government
Abstract Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.
more »
« less
Fingertip Non-Contact Optoacoustic Sensor for Near-Distance Ranging and Thickness Differentiation for Robotic Grasping
We report the feasibility study of a new optoacoustic sensor for both near-distance ranging and material thickness classification for robotic grasping. It is based on the optoacoustic effect where focused laser pulses are used to generate wideband ultrasound signals in the target. With a much smaller optical focal spot, the optoacoustic sensor achieves a lateral resolution of 93 μm, which is six times higher than ultrasound pulse-echo ranging under the same condition. A new multi-mode wide and PZT (lead zirconate titanate) transducer is built to properly receive the wideband optoacoustic signal. The ability to receive both low- and high-frequency components of the optoacoustic signal enhances the material sensing capability, which makes it promising to determine not only material type but also the sub-surface structures. For demonstration, optoacoustic spectra are collected from hard and soft materials with different thickness. A Bag-of-SFA-Symbols (BOSS) classifier is designed to perform primary material and then thickness classification based on the optoacoustic spectra. The accuracy of material / thickness classification reaches >99% and >94%, respectively, which shows the feasibility of differentiating solid materials with different thickness by the optoacoustic sensor.
more »
« less
- Award ID(s):
- 1925037
- PAR ID:
- 10206855
- Date Published:
- Journal Name:
- IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, Oct. 25-29, 2020.
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract A bidirectional brain interface with both “write” and “read” functions can be an important tool for fundamental studies and potential clinical treatments for neurological diseases. Herein, a miniaturized multifunctional fiber‐based optoacoustic emitter (mFOE) is reported thatintegrates simultaneous optoacoustic stimulation for “write” and electrophysiology recording of neural circuits for “read”. Because of the intrinsic ability of neurons to respond to acoustic wave, there is no requirement of the viral transfection. The orthogonality between optoacoustic waves and electrical field provides a solution to avoid the interference between electrical stimulation and recording. The stimulation function of the mFOE is first validated in cultured ratcortical neurons using calcium imaging. In vivo application of mFOE for successful simultaneous optoacoustic stimulation and electrical recording of brain activities is confirmed in mouse hippocampus in both acute and chronical applications up to 1 month. Minor brain tissue damage is confirmed after these applications. The capability of simultaneous neural stimulation and recording enabled by mFOE opens up new possibilities for the investigation of neural circuits and brings new insights into the study of ultrasound neurostimulation.more » « less
-
Langfelder, Giacomo (Ed.)In this letter, we report on a high-sensitivity whispering gallery mode (WGM) resonator-based air-coupled ultrasound sensor capable of detecting minute pressure variations across an ultrasound frequency spectrum of 0.6–3.5 MHz. The sensor comprises a microspherical glass shell of approximately 450 μm in radius and nonuniform shell thickness of 7–15 μm, which is optically coupled to a tunable laser for resonance excitation. The setup allows for the precise measurement of acoustic signals, benefiting from the high optical Q-factor of ∼2 million of the blown glass microspherical shells. A noise equivalent pressure as low as 40 μPa/ √Hz was obtained at 1.72-MHz ultrasound frequency. A very good correspondence between the simulated axisymmetric resonance frequencies measured using the WGM resonator and a 3D finite-element analysis model in COMSOL was established. The sensor showed an expected linear dependence on the drive voltage of the ultrasound transducer. The distortion of the microspherical shell under acoustic pressure was also independently confirmed using a laser Doppler vibrometer. The sensor’s capability to handle high-frequency ultrasonic waves with significantly better signal-to-noise ratio than conventional piezoelectric- or microphone-based systems is demonstrated, highlighting its suitability for advanced photoacoustic applications.more » « less
-
This work presents numerical modeling-based investigations for detecting and monitoring damage growth and material nonlinearity in plate structures using topological acoustic (TA) and sideband peak count (SPC)-based sensing techniques. The nonlinear ultrasonic SPC-based technique (SPC-index or SPC-I) has shown its effectiveness in monitoring damage growth affecting various engineering materials. However, the new acoustic parameter, “geometric phase change (GPC)” and GPC-index (or GPC-I), derived from the TA sensing technique adopted for monitoring damage growth or material nonlinearity has not been reported yet. The damage growth modeling is carried out by the peri-ultrasound technique to simulate nonlinear interactions between elastic waves and damages (cracks). For damage growth with a purely linear response and for the nonlinearity arising from only the nonlinear stress–strain relationship of the material, the numerical analysis is conducted by the finite element method (FEM) in the Abaqus/CAE 2021 software. In both numerical modeling scenarios, the SPC- and GPC-based techniques are adopted to capture and compare those responses. The computed results show that, from a purely linear scattering response in FEM modeling, the GPC-I can effectively detect the existence of damage but cannot monitor damage growth since the linear scattering differences are small when crack thickness increases. The SPC-I does not show any change when a nonlinear response is not generated. However, the nonlinear response from the damage growth can be efficiently modeled by the nonlocal peri-ultrasound technique. Both the GPC-I and SPC-I techniques can clearly show the damage evolution process if the frequencies are properly chosen. This investigation also shows that the GPC-I indicator has the capability to distinguish nonlinear materials from linear materials while the SPC-I is found to be more effective in distinguishing between different types of nonlinear materials. This work can reveal the mechanism of GPC-I for capturing linear and nonlinear responses, and thus can provide guidance in structural health monitoring (SHM).more » « less
-
Many people struggle with mobility impairments due to lower limb amputations. To participate in society, they need to be able to walk on a wide variety of terrains, such as stairs, ramps, and level ground. Current lower limb powered prostheses require different control strategies for varying ambulation modes, and use data from mechanical sensors within the prosthesis to determine which ambulation mode the user is in. However, it can be challenging to distinguish between ambulation modes. Efforts have been made to improve classification accuracy by adding electromyography information, but this requires a large number of sensors, has a low signal-to-noise ratio, and cannot distinguish between superficial and deep muscle activations. An alternative sensing modality, A-mode ultrasound, can detect and distinguish between changes in superficial and deep muscles. It has also shown promising results in upper limb gesture classification. Despite these advantages, A-mode ultrasound has yet to be employed for lower limb activity classification. Here we show that A- mode ultrasound can classify ambulation mode with comparable, and in some cases, superior accuracy to mechanical sensing. In this study, seven transfemoral amputee subjects walked on an ambulation circuit while wearing A-mode ultrasound transducers, IMU sensors, and their passive prosthesis. The circuit consisted of sitting, standing, level-ground walking, ramp ascent, ramp descent, stair ascent, and stair descent, and a spatial–temporal convolutional network was trained to continuously classify these seven activities. Offline continuous classification with A-mode ultrasound alone was able to achieve an accuracy of 91.8±3.4%, compared with 93.8±3.0%, when using kinematic data alone. Combined kinematic and ultrasound produced 95.8±2.3% accuracy. This suggests that A-mode ultrasound provides additional useful information about the user’s gait beyond what is provided by mechanical sensors, and that it may be able to improve ambulation mode classification. By incorporating these sensors into powered prostheses, users may enjoy higher reliability for their prostheses, and more seamless transitions between ambulation modes.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
