skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Early Wildfire Smoke Detection Based on Motion-based Geometric Image Transformation and Deep Convolutional Generative Adversarial Networks
Title: Early Wildfire Smoke Detection Based on Motion-based Geometric Image Transformation and Deep Convolutional Generative Adversarial Networks
Early detection of wildfire smoke in real-time is essentially important in forest surveillance and monitoring systems. We propose a vision-based method to detect smoke using Deep Convolutional Generative Adversarial Neural Networks (DC-GANs). Many existing supervised learning approaches using convolutional neural networks require substantial amount of labeled data. In order to have a robust representation of sequences with and without smoke, we propose a two-stage training of a DCGAN. Our training framework includes, the regular training of a DCGAN with real images and noise vectors, and training the discriminator separately using the smoke images without the generator. Before training the networks, the temporal evolution of smoke is also integrated with a motion-based transformation of images as a pre-processing step. Experimental results show that the proposed method effectively detects the smoke images with negligible false positive rates in real-time.  more » « less
Award ID(s):
1739396
PAR ID:
10109700
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Page Range / eLocation ID:
8315 to 8319
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; (, Space Weather)
    Abstract This study evaluates the performance of deep learning approach in the prediction of the ionospheric total electron content (TEC) during magnetically quiet periods. Two deep learning techniques, long short‐term memory (LSTM) and convolutional LSTM (ConvLSTM), are employed to predict TEC values 24 hr ahead in the vicinity of the Korean Peninsula (26.5°–40°N, 121°–134.5°E). The LSTM method predicts TEC at a single point based on time series of data at that point, whereas the ConvLSTM method simultaneously predicts TEC values at multiple points using spatiotemporal distribution of TEC. Both the LSTM and ConvLSTM models are trained using the complete regional TEC maps reconstructed by applying the Deep Convolutional Generative Adversarial Network–Poisson Blending (DCGAN‐PB) method to observed TEC data. The training period spans from 2002 to 2018, and the model performance is evaluated using 2019 data. Our results show that the ConvLSTM method outperforms the LSTM method, generating more reliable TEC maps with smaller root mean square errors when compared to the ground truth (DCGAN‐PB TEC maps). This outcome indicates that deep learning models can improve the prediction accuracy of TEC at a specific point by taking into account spatial information of TEC. We conclude that ConvLSTM is a reliable and efficient approach for the prompt ionospheric prediction. 
    more » « less
  2. ; ; ; ; ; ; ; ; (, Space Weather)
    Abstract This study reconstructs total electron content (TEC) maps in the vicinity of the Korean Peninsula by employing a deep convolutional generative adversarial network and Poisson blending (DCGAN‐PB). Our interest is to rebuild small‐scale ionosphere structures on the TEC map in a local region where pronounced ionospheric structures, such as the equatorial ionization anomaly, are absent. The reconstructed regional TEC maps have a domain of 120°–135.5°E longitude and 25.5°–41°N latitude with 0.5° resolution. To achieve this, we first train a DCGAN model by using the International Reference Ionosphere‐based TEC maps from 2002 to 2019 (except for 2010 and 2014) as a training data set. Next, the trained DCGAN model generates synthetic complete TEC maps from observation‐based incomplete TEC maps. Final TEC maps are produced by blending of synthetic TEC maps with observed TEC data by PB. The performance of the DCGAN‐PB model is evaluated by testing the regeneration of the masked TEC observations in 2010 (solar minimum) and 2014 (solar maximum). Our results show that a good correlation between the masked and model‐generated TEC values is maintained even with a large percentage (∼80%) of masking. The performance of the DCGAN‐PB model is not sensitive to local time, solar activity, and magnetic activity. Thus, the DCGAN‐PB model can reconstruct fine ionospheric structures in regions where observations are sparse and distinguishing ionospheric structures are absent. This model can contribute to near real‐time monitoring of the ionosphere by immediately providing complete TEC maps. 
    more » « less
  3. ; ; ; (, Journal of Imaging)
    In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to approximate when noise affects the data. Really, one limitation of neural networks for deblurring is their sensitivity to noise and other perturbations, which can lead to instability and produce poor reconstructions. In addition, networks do not necessarily take into account the numerical formulation of the underlying imaging problem when trained end-to-end. In this paper, we propose some strategies to improve stability without losing too much accuracy to deblur images with deep-learning-based methods. First, we suggest a very small neural architecture, which reduces the execution time for training, satisfying a green AI need, and does not extremely amplify noise in the computed image. Second, we introduce a unified framework where a pre-processing step balances the lack of stability of the following neural-network-based step. Two different pre-processors are presented. The former implements a strong parameter-free denoiser, and the latter is a variational-model-based regularized formulation of the latent imaging problem. This framework is also formally characterized by mathematical analysis. Numerical experiments are performed to verify the accuracy and stability of the proposed approaches for image deblurring when unknown or not-quantified noise is present; the results confirm that they improve the network stability with respect to noise. In particular, the model-based framework represents the most reliable trade-off between visual precision and robustness. 
    more » « less
  4. ; ; (, PLOS One)
    Yanwu, Xu (Ed.)
    Lung cancer is a major cause of cancer-related deaths, and early diagnosis and treatment are crucial for improving patients’ survival outcomes. In this paper, we propose to employ convolutional neural networks to model the non-linear relationship between the risk of lung cancer and the lungs’ morphology revealed in the CT images. We apply a mini-batched loss that extends the Cox proportional hazards model to handle the non-convexity induced by neural networks, which also enables the training of large data sets. Additionally, we propose to combine mini-batched loss and binary cross-entropy to predict both lung cancer occurrence and the risk of mortality. Simulation results demonstrate the effectiveness of both the mini-batched loss with and without the censoring mechanism, as well as its combination with binary cross-entropy. We evaluate our approach on the National Lung Screening Trial data set with several 3D convolutional neural network architectures, achieving high AUC and C-index scores for lung cancer classification and survival prediction. These results, obtained from simulations and real data experiments, highlight the potential of our approach to improving the diagnosis and treatment of lung cancer. 
    more » « less
  5. ; ; (, Sensors)
    Significant resources have been spent in collecting and storing large and heterogeneous radar datasets during expensive Arctic and Antarctic fieldwork. The vast majority of data available is unlabeled, and the labeling process is both time-consuming and expensive. One possible alternative to the labeling process is the use of synthetically generated data with artificial intelligence. Instead of labeling real images, we can generate synthetic data based on arbitrary labels. In this way, training data can be quickly augmented with additional images. In this research, we evaluated the performance of synthetically generated radar images based on modified cycle-consistent adversarial networks. We conducted several experiments to test the quality of the generated radar imagery. We also tested the quality of a state-of-the-art contour detection algorithm on synthetic data and different combinations of real and synthetic data. Our experiments show that synthetic radar images generated by generative adversarial network (GAN) can be used in combination with real images for data augmentation and training of deep neural networks. However, the synthetic images generated by GANs cannot be used solely for training a neural network (training on synthetic and testing on real) as they cannot simulate all of the radar characteristics such as noise or Doppler effects. To the best of our knowledge, this is the first work in creating radar sounder imagery based on generative adversarial network. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email