Abstract Whitecaps generated by wave breaking and air entrainment can be classified as active (stageA) or residual (stageB). Measurement of each stage individually is essential for accurate parameterization of air–sea interaction processes, but conventional methods used for separation in visible images are subjective. In this study, this problem is solved using a pipeline for active whitecap fraction measurement. In this pipeline, a new horizon detection method is developed to stabilize and rectify images, and a deep learning model based on U-Net is trained and validated to identify and extract active whitecaps. The model demonstrates robust prediction accuracy even when images are contaminated by sun glint. The model is applied to 48 h of video footage collected during a cruise in Gulf of Mexico. It is determined that, as a function of wind speed, the active whitecap fraction has significant variability and disparity compared to previous research. This finding indicates that secondary factors should be considered for accurate whitecap parameterization. This is explored using a random forest, which indicates that sea surface temperature, swell, and wave age are important to the active whitecap fraction. The precise impact of sea surface temperature is further explored using analyses of variance (ANOVA), which suggest it has a positive correlation with the active whitecap fraction.
more »
« less
A Novel Method to Discriminate Active from Residual Whitecaps Using Particle Image Velocimetry
Whitecap foam generated by wind-driven wave breaking is distinguished as either active (stage A) or residual (stage B). Discrimination of whitecap stages is essential to quantify the influence of whitecaps on the physical and chemical processes at the marine boundary layer. This study provides a novel method to identify whitecap stages based on visible imagery using particle image velocimetry (PIV). Data used are from a Gulf of Mexico cruise where collocated infrared (IR) and visible cameras simultaneously recorded whitecaps. IR images were processed by an established thresholding method to determine stage A lifetime from brightness temperature. The visible images were also filtered using a thresholding method and then processed using PIV to estimate the average whitecap velocity. A linear relationship was established between the lifetime of stage A and the timescale of averaged velocity. This novel method allows stage A whitecap lifetime to be determined using whitecap velocity and provides an objective approach to separate whitecap stages. This method paves the way for future research to easily quantify whitecap stages using affordable off-the-shelf video cameras. Results, which include evidence that whitecaps stop advancing before stage A ends and may be an indication of bubble plume degassing, are discussed.
more »
« less
- Award ID(s):
- 1829986
- PAR ID:
- 10387934
- Date Published:
- Journal Name:
- Remote Sensing
- Volume:
- 13
- Issue:
- 20
- ISSN:
- 2072-4292
- Page Range / eLocation ID:
- 4051
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Novel push-pull systems comprised of triphenylamine-tetracyanobutadiene, a high-energy CT species is linked to a near-IR sensitizer, azaBODIPY, for promoting excited state CS. These new systems revealed panchromatic absorption due to combined effect of intramolecular CT, and near-IR absorbing azaBODIPY. Using electrochemical and computational studies, energy levels were established to visualize excited state events. Fs-TA studies were performed to monitor excited state CT events. From target analysis, the effect of solvent polarity, number of linked CT entities, and excitation wavelength dependence in governing the lifetime of CS states was established. Electron exchange between two TPA-TCBD entities in 3 seem to prolong lifetime of the CS state. Importantly, we have been successful in demonstrating efficient CS upon both high-energy CT and low-energy near-IR excitations, signifying importance of these push-pull systems for optoelectronic applications operating in the wide optical window.more » « less
-
Performing a direct match between images from different spectra (i.e., passive infrared and visible) is challenging because each spectrum contains different information pertaining to the subject’s face. In this work, we investigate the benefits and limitations of using synthesized visible face images from thermal ones and vice versa in cross-spectral face recognition systems. For this purpose, we propose utilizing canonical correlation analysis (CCA) and manifold learning dimensionality reduction (LLE). There are four primary contributions of this work. First, we formulate the cross-spectral heterogeneous face matching problem (visible to passive IR) using an image synthesis framework. Second, a new processed database composed of two datasets consistent of separate controlled frontal face subsets (VIS-MWIR and VIS-LWIR) is generated from the original, raw face datasets collected in three different bands (visible, MWIR and LWIR). This multi-band database is constructed using three different methods for preprocessing face images before feature extraction methods are applied. There are: (1) face detection, (2) CSU’s geometric normalization, and (3) our recommended geometric normalization method. Third, a post-synthesis image denoising methodology is applied, which helps alleviate different noise patterns present in synthesized images and improve baseline FR accuracy (i.e. before image synthesis and denoising is applied) in practical heterogeneous FR scenarios. Finally, an extensive experimental study is performed to demonstrate the feasibility and benefits of cross-spectral matching when using our image synthesis and denoising approach. Our results are also compared to a baseline commercial matcher and various academic matchers provided by the CSU’s Face Identification Evaluation System.more » « less
-
null (Ed.)Lensless imaging has emerged as a potential solution towards realizing ultra-miniature cameras by eschewing the bulky lens in a traditional camera. Without a focusing lens, the lensless cameras rely on computational algorithms to recover the scenes from multiplexed measurements. However, the current iterative-optimization-based reconstruction algorithms produce noisier and perceptually poorer images. In this work, we propose a non-iterative deep learning-based reconstruction approach that results in orders of magnitude improvement in image quality for lensless reconstructions. Our approach, called FlatNet, lays down a framework for reconstructing high-quality photorealistic images from mask-based lensless cameras, where the camera's forward model formulation is known. FlatNet consists of two stages: (1) an inversion stage that maps the measurement into a space of intermediate reconstruction by learning parameters within the forward model formulation, and (2) a perceptual enhancement stage that improves the perceptual quality of this intermediate reconstruction. These stages are trained together in an end-to-end manner. We show high-quality reconstructions by performing extensive experiments on real and challenging scenes using two different types of lensless prototypes: one which uses a separable forward model and another, which uses a more general non-separable cropped-convolution model. Our end-to-end approach is fast, produces photorealistic reconstructions, and is easy to adopt for other mask-based lensless cameras.more » « less
-
Optical flow velocimetry (OFV) is a method for determining dense and accurate velocity fields from a pair of particle images by solving the classical optical flow problem. However, this is an ill-posed inverse problem, which generally entails minimizing a weighted sum of two terms–fidelity and regularization–and the weights in the sum are parameters that require manual tuning based on the properties of both the flow and the particle images. This manual tuning has historically been a consistent challenge that has limited the general applicability of OFV for experimental data, as the calculated velocity field is sensitive to the value of the weights. This work proposes a hierarchical model for the weighting parameters in the framework of a maximum a posteriori-based Bayesian optimization approach. The method replaces the classical Lagrange multiplier weighting parameter with a new, less-sensitive parameter that can be automatically predetermined from experimental images. The resulting method is tested on three different synthetic particle image velocimetry (PIV) datasets and on experimental particle images. The method is found to be capable of self-adjusting the local weights of the optimization process in real-time while simultaneously determining the velocity field, leading to an optimally regularized estimate of the velocity field without requiring any dataset-specific manual tuning of the parameters. The presented approach is the first truly general, parameter-free optical flow method for particle image velocimetry (PIV) images. The developed method is freely available as a part of the PIVlab package.more » « less
An official website of the United States government

