skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Spatially resolved stereoscopic surface profiling by using a feature-selective segmentation and merging technique
Abstract We present a feature-selective segmentation and merging technique to achieve spatially resolved surface profiles of the parts by 3D stereoscopy and strobo-stereoscopy. A pair of vision cameras capture images of the parts at different angles, and 3D stereoscopic images can be reconstructed. Conventional filtering processes of the 3D images involve data loss and lower the spatial resolution of the image. In this study, the 3D reconstructed image was spatially resolved by automatically recognizing and segmenting the features on the raw images, locally and adaptively applying super-resolution algorithm to the segmented images based on the classified features, and then merging those filtered segments. Here, the features are transformed into masks that selectively separate the features and background images for segmentation. The experimental results were compared with those of conventional filtering methods by using Gaussian filters and bandpass filters in terms of spatial frequency and profile accuracy. As a result, the selective feature segmentation technique was capable of spatially resolved 3D stereoscopic imaging while preserving imaging features.  more » « less
Award ID(s):
1902697
PAR ID:
10337516
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Surface Topography: Metrology and Properties
Volume:
10
Issue:
1
ISSN:
2051-672X
Page Range / eLocation ID:
014002
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Energies)
    null (Ed.)
    X-ray CT imaging provides a 3D view of a sample and is a powerful tool for investigating the internal features of porous rock. Reliable phase segmentation in these images is highly necessary but, like any other digital rock imaging technique, is time-consuming, labor-intensive, and subjective. Combining 3D X-ray CT imaging with machine learning methods that can simultaneously consider several extracted features in addition to color attenuation, is a promising and powerful method for reliable phase segmentation. Machine learning-based phase segmentation of X-ray CT images enables faster data collection and interpretation than traditional methods. This study investigates the performance of several filtering techniques with three machine learning methods and a deep learning method to assess the potential for reliable feature extraction and pixel-level phase segmentation of X-ray CT images. Features were first extracted from images using well-known filters and from the second convolutional layer of the pre-trained VGG16 architecture. Then, K-means clustering, Random Forest, and Feed Forward Artificial Neural Network methods, as well as the modified U-Net model, were applied to the extracted input features. The models’ performances were then compared and contrasted to determine the influence of the machine learning method and input features on reliable phase segmentation. The results showed considering more dimensionality has promising results and all classification algorithms result in high accuracy ranging from 0.87 to 0.94. Feature-based Random Forest demonstrated the best performance among the machine learning models, with an accuracy of 0.88 for Mancos and 0.94 for Marcellus. The U-Net model with the linear combination of focal and dice loss also performed well with an accuracy of 0.91 and 0.93 for Mancos and Marcellus, respectively. In general, considering more features provided promising and reliable segmentation results that are valuable for analyzing the composition of dense samples, such as shales, which are significant unconventional reservoirs in oil recovery. 
    more » « less
  2. ; (, American Society for Precision Engineering)
    null (Ed.)
    Drilling and milling operations are material removal processes involved in everyday conventional productions, especially in the high-speed metal cutting industry. The monitoring of tool information (wear, dynamic behavior, deformation, etc.) is essential to guarantee the success of product fabrication. Many methods have been applied to monitor the cutting tools from the information of cutting force, spindle motor current, vibration, as well as sound acoustic emission. However, those methods are indirect and sensitive to environmental noises. Here, the in-process imaging technique that can capture the cutting tool information while cutting the metal was studied. As machinists judge whether a tool is worn-out by the naked eye, utilizing the vision system can directly present the performance of the machine tools. We proposed a phase shifted strobo-stereoscopic method (Figure 1) for three-dimensional (3D) imaging. The stroboscopic instrument is usually applied for the measurement of fast-moving objects. The operation principle is as follows: when synchronizing the frequency of the light source illumination and the motion of object, the object appears to be stationary. The motion frequency of the target is transferring from the count information of the encoder signals from the working rotary spindle. If small differences are added to the frequency, the object appears to be slowly moving or rotating. This effect can be working as the source for the phase-shifting; with this phase information, the target can be whole-view 3D reconstructed by 360 degrees. The stereoscopic technique is embedded with two CCD cameras capturing images that are located bilateral symmetrically in regard to the target. The 3D scene is reconstructed by the location information of the same object points from both the left and right images. In the proposed system, an air spindle was used to secure the motion accuracy and drilling/milling speed. As shown in Figure 2, two CCDs with 10X objective lenses were installed on a linear rail with rotary stages to capture the machine tool bit raw picture for further 3D reconstruction. The overall measurement process was summarized in the flow chart (Figure 3). As the count number of encoder signals is related to the rotary speed, the input speed (unit of RPM) was set as the reference signal to control the frequency (f0) of the illumination of the LED. When the frequency was matched with the reference signal, both CCDs started to gather the pictures. With the mismatched frequency (Δf) information, a sequence of images was gathered under the phase-shifted process for a whole-view 3D reconstruction. The study in this paper was based on a 3/8’’ drilling tool performance monitoring. This paper presents the principle of the phase-shifted strobe-stereoscopic 3D imaging process. A hardware set-up is introduced, , as well as the 3D imaging algorithm. The reconstructed image analysis under different working speeds is discussed, the reconstruction resolution included. The uncertainty of the imaging process and the built-up system are also analyzed. As the input signal is the working speed, no other information from other sources is required. This proposed method can be applied as an on-machine or even in-process metrology. With the direct method of the 3D imaging machine vision system, it can directly offer the machine tool surface and fatigue information. This presented method can supplement the blank for determining the performance status of the machine tools, which further guarantees the fabrication process. 
    more » « less
  3. ; ; ; ; (, Journal of Analytical Atomic Spectrometry)
    Push-broom hyperspectral imaging (Pb-HSI) is a powerful technique for obtaining the spectral information along with the spatial information simultaneously for various applications, from remote sensing to chemical imaging. Spatial resolution improvement is beneficial in many instances; however, typical solutions suffer from the limitation of geometric extent, lowered light throughput, or reduced field-of-view (FOV). Sub-pixel shifting (SPS) acquires higher-resolution images, compared to typical imaging approaches, from the deconvolution of low-resolution images acquired with a higher sampling rate. Furthermore, SPS is particularly suited for Pb-HSI due to its scanning nature. In this study, an SPS approach is developed and implemented on a Pb-HSI system for plasma optical emission spectroscopy. The preliminary results showed that a periodic deconvolution error was generated in the final SPS Pb-HSI images. The periodic error was traced back to random noise present in the raw/convoluted SPS data and its frequency displays an inverse relationship with the number of sub-pixel samples acquired. Computer modelled data allows studying the effect of varying the relative standard deviation (RSD) in the raw/convoluted SPS data on the final reconstructed SPS images and optimization of noise filtering. The optimized SPS Pb-HSI technique was used to acquire the line-of-sight integrated optical emission maps from an atmospheric pressure micro-capillary dielectric barrier discharge (μDBD). The selected plasma species of interest (He, I, N 2 , N 2 + , and O) yield some insight into the underlying mechanisms. The SPS Pb-HSI technique developed here will allow implementing geometric super-resolution in many applications, for example, it will be used for extracting radially resolved information from Abel's inversion protocols, where improved fitting is expected due to the increase in resolution/data points. 
    more » « less
  4. ; ; ; ; ; ; (, The International Journal of Advanced Manufacturing Technology)
    This paper introduces a simple three-dimensional (3D) stereoscopic method using a single unit of an imaging device consisting of a charge-coupled device (CCD) and a zoom lens. Unlike conventional stereoscopy, which requires a pair of imaging devices, 3D surface imaging is achieved by 3D image reconstruction of two images obtained from two different camera positions by scanning. The experiments were performed by obtaining two images of the measurement target in two different ways: (1) by moving the object while the imaging device is stationary, and (2) by moving the imaging device while the object is stationary. Conventional stereoscopy is limited by disparity errors in 3D image reconstruction because a pair of imaging devices is not ideally identical and alignment errors are always present in the imaging system setup. The proposed method significantly reduced the disparity error in 3D image reconstruction, and the calibration process of the imaging system became simple and convenient. The proposed imaging system showed a disparity error of 0.26 in the camera pixel. 
    more » « less
  5. ; ; ; ; (, Applied Spectroscopy)
    null (Ed.)
    A new hyperspectral Raman imaging technique is described using a spatial heterodyne Raman spectrometer (SHRS) and a microlens array (MLA). The new technique enables the simultaneous acquisition of Raman spectra over a wide spectral range at spatially isolated locations within two spatial dimensions ( x, y) using a single exposure on a charge-coupled device (CCD) or other detector types such as a complementary metal-oxide semiconductor (CMOS) detector. In the SHRS system described here, a 4 × 4 mm MLA with 1600, 100 µm diameter lenslets is used to image the sample, with each lenslet illuminating a different region of the SHRS diffraction gratings and forming independent fringe images on the CCD. The fringe images from each lenslet contain the fully encoded Raman spectrum of the region of the sample “seen” by the lenslet. Since the SHRS requires no moving parts, all fringe images can be measured simultaneously with a single detector exposure, and in principle using a single laser shot, in the case of a pulsed laser. In this proof of concept paper, hyperspectral Raman spectra of a wide variety of heterogeneous samples are used to characterize the technique in terms of spatial and spectral resolution tradeoffs. It is shown that the spatial resolution is a function of the diameter of the MLA lenslets, while the number of spatial elements that can be resolved is equal to the number of MLA lenslets that can be imaged onto the SHRS detector. The spectral resolution depends on the spatial resolution desired, and the number of grooves illuminated on both diffraction gratings by each lenslet, or combination of lenslets in cases where they are grouped. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email